-- Logs begin at Wed 2022-09-14 00:20:42 UTC, end at Wed 2022-09-14 01:31:32 UTC. -- Sep 14 00:56:11.411105 dv-cinder-857528-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 14 00:56:11.419792 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 14 00:56:11.421817 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 14 00:56:11 2022] *** Sep 14 00:56:11.421817 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 14 00:56:11.421817 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 14 00:56:11.421817 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: nodename: dv-cinder-857528-1-iscsi Sep 14 00:56:11.421817 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: machine: x86_64 Sep 14 00:56:11.421817 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: clock source: unix Sep 14 00:56:11.421817 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: pcre jit disabled Sep 14 00:56:11.421817 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: detected number of CPU cores: 4 Sep 14 00:56:11.421817 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: current working directory: / Sep 14 00:56:11.421817 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: detected binary path: /usr/bin/uwsgi-core Sep 14 00:56:11.422484 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: your processes number limit is 47680 Sep 14 00:56:11.422484 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: your memory page size is 4096 bytes Sep 14 00:56:11.422484 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: detected max file descriptor number: 2048 Sep 14 00:56:11.422484 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: lock engine: pthread robust mutexes Sep 14 00:56:11.422484 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: thunder lock: enabled Sep 14 00:56:11.422484 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 14 00:56:11.422484 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 14 00:56:11.461567 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: Python main interpreter initialized at 0x55e18a10a9c0 Sep 14 00:56:11.461567 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: python threads support enabled Sep 14 00:56:11.461567 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: your server socket listen backlog is limited to 100 connections Sep 14 00:56:11.461567 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: your mercy for graceful operations on workers is 90 seconds Sep 14 00:56:11.461893 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: mapped 403077 bytes (393 KB) for 2 cores Sep 14 00:56:11.461974 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: *** Operational MODE: preforking *** Sep 14 00:56:11.462222 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: *** uWSGI is running in multiple interpreter mode *** Sep 14 00:56:11.462222 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: spawned uWSGI master process (pid: 105633) Sep 14 00:56:11.462410 dv-cinder-857528-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 14 00:56:11.465331 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: spawned uWSGI worker 1 (pid: 105634, cores: 1) Sep 14 00:56:11.465331 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: spawned uWSGI worker 2 (pid: 105635, cores: 1) Sep 14 00:56:11.465331 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 14 00:56:12.120614 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 14 00:56:12.121225 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 14 00:56:13.203167 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 00:56:13.203167 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: from cryptography.utils import int_from_bytes Sep 14 00:56:13.203823 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 00:56:13.203823 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: from cryptography.utils import int_from_bytes Sep 14 00:56:13.204209 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 00:56:13.204209 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: from cryptography.utils import int_from_bytes Sep 14 00:56:13.204326 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 00:56:13.204326 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: from cryptography.utils import int_from_bytes Sep 14 00:56:15.696731 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 00:56:15.697388 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 00:56:15.697741 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 00:56:15.697839 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 00:56:15.697934 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 00:56:15.698024 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 00:56:15.698107 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 00:56:15.698193 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 00:56:15.698274 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 00:56:15.698361 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 00:56:15.698453 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.698683 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.698782 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.699001 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.699100 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.699317 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.699424 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.699656 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.699761 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.699980 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.700096 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.700286 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.700394 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.700597 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.700692 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.700910 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.701007 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.701166 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.701255 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.701469 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.701611 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.701776 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.701866 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857528-1-iscsi {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.702093 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.702179 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857528-1-iscsi {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.702402 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.702496 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.702698 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.702786 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.703007 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.703100 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.703304 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.703399 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.703621 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.703724 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.703934 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.704021 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.704229 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.704427 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.704722 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.704871 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.705027 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.705153 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.705365 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.705494 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.705731 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.705847 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.706067 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.706170 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.706372 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.706478 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.706674 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.706762 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.706986 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.707073 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.707289 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.707383 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.707627 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.707718 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.707933 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.708049 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857528-1-iscsi {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.708322 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.708415 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857528-1-iscsi {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.708631 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.708719 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.708933 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.709026 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.709238 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.709330 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.709634 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.709729 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.709936 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.710031 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.710237 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.710340 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.710554 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.710654 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.710853 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.710956 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.711153 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.711242 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.711471 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.711578 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.711809 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.711956 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.712118 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.712207 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.712421 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.712521 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.712715 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.712822 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.713020 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.713106 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.713318 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.713411 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.713620 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.713708 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.713915 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.714012 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.714161 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.714247 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.714441 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.714539 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.714741 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.714829 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.715052 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.715146 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.715364 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.715458 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.715640 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.715776 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.715886 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.715991 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.716194 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.716295 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.716504 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.716608 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.716806 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.716903 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.717105 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.717200 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.717404 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.717507 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.717700 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.717795 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.717999 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.718102 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.718296 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.718413 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.718595 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.718692 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.718891 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.718988 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.719189 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.719286 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.719499 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.719607 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.719830 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.719928 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.720141 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.720249 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.720440 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.720545 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.720754 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.720852 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.721755 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.721870 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.721972 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.722061 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.722211 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.722309 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.722543 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.722661 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.722854 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.722959 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.723158 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.723256 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.723472 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.723599 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.723811 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.723908 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.724113 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.724208 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.724413 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.724522 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.724713 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.724817 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.725026 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.725124 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.725341 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.725438 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.725592 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.725689 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.725866 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.725967 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.726162 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.726258 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.726458 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.726554 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.726766 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.726870 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.727063 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.727166 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.727364 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.727467 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.727684 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.727780 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.727977 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.728124 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.728259 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.728393 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.728562 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.728715 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.728860 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.729002 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.729137 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.729271 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.729432 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.729583 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.729718 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.729851 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.730018 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.730202 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.730356 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.730500 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.730653 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.730789 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.730875 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.730963 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.731181 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.731279 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.731493 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.731614 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.731816 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.731950 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.732113 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.732211 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.732398 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.732497 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.732698 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.732786 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.733005 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.733104 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.733307 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.733393 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.733606 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.733701 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.733911 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.734015 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.734206 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.734292 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.734504 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.734608 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.734807 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.734902 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.735102 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.735194 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.735398 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.735497 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.735721 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.735811 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.736014 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.736102 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.736314 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.736454 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.737149 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.737247 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.737463 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.737550 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.737765 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.737851 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.738068 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.738156 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.738369 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.738456 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.738672 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.738767 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.738971 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.739065 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.739269 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.739356 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.739580 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.739682 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.739881 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.739968 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.740197 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.740289 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.740502 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.740596 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.740805 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.740896 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.741107 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.741193 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.741407 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.741501 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.741721 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 00:56:15.741814 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.742051 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.742147 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.742377 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.742480 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.742698 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.742784 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.743013 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.743105 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.743345 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.743432 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.743686 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.743776 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.743998 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.744086 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.744311 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.744399 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.744633 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.744719 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.744944 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.745039 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.745250 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.745337 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.745555 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.745649 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.745857 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.745956 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.746169 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.746270 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.746482 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.746582 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.746796 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.746882 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.747106 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.747192 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.747415 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.747504 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.747748 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.747838 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.748053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.748140 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.748368 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.748458 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.748682 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.748781 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.748992 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.749079 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.749297 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.749393 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.749629 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.749726 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.749953 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.750040 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.750261 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.750355 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.750578 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.750677 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.750886 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.750973 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.751189 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.751275 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.751493 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.751612 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.751822 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.751911 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.752181 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.752281 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.752492 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.752584 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.752812 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.752900 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.753122 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.753209 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.753442 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.753532 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.753751 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.753846 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.754058 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.754146 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.754365 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.754454 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.754674 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.754762 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.754977 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.755070 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.755283 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.755371 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.755626 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.755729 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.755939 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.756045 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.756247 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.756333 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.756555 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.756687 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.756861 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.756959 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.757165 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.757251 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.757465 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.757551 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.757772 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.757922 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.758061 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.758195 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.758370 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.758532 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.758665 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.758820 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.758972 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.759116 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.759252 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.759386 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.759520 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.759687 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.759826 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.759964 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.760144 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.760276 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.760448 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.760621 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.760752 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.760884 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.761060 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.761192 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.761618 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.761749 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.761920 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.762053 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.762222 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.762366 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.762527 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.762659 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.762802 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.762934 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.763100 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.763232 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.763404 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.763537 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.763745 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.763881 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.764048 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.764196 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.764331 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.764464 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.764646 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.764795 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.764929 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.765071 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.765232 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.765368 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.765538 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.765675 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.765840 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.765985 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.766146 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.766282 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.766450 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.766587 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.766740 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.766886 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.767056 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.767200 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.767362 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.767498 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.767687 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.767886 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.768060 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.768193 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.768365 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.768533 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.768685 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.768823 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.768999 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.769137 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.769316 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.769449 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.769621 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.769760 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.769932 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.770064 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.770234 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.770375 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.770522 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.770667 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.770825 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.770969 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.771133 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.771276 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.771436 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.771630 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.771765 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.771902 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.772037 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.772187 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.772348 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.772586 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.772698 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.772793 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.772952 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.773057 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.773258 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.773346 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.773562 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.773658 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.773860 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.773959 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.774159 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.774256 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.774456 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.774543 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.774784 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.774873 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.775084 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.775171 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.775421 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.775519 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.775775 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.776136 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.776228 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.776410 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.776498 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.776717 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.776833 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.777030 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.777130 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.777333 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.777429 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.777640 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.777737 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.777946 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.778034 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.778253 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.778338 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.778565 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.778660 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.778869 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.778958 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.779181 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.779276 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.779486 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.779596 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.779827 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.779917 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.780133 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.780222 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.780446 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.780542 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.780747 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.780835 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.781056 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.781145 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.781392 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.781496 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.781719 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.781806 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.782029 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.782123 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.782354 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.782443 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.782658 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.782834 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.782978 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.783122 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.783270 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.783960 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.784098 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.784236 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.784518 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.784667 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.784810 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.784946 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.785084 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.785226 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.785374 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.785520 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.785659 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.785794 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.786071 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.786214 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.786358 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.786502 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.786639 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.786774 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.786934 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.787065 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.787222 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.787359 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.787495 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.787656 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.787796 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.787948 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.788066 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.788158 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.788376 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.788465 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.788689 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.788777 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.789011 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.789099 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.789321 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.789416 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.789625 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.789711 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.789932 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.790021 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.790236 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.790323 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.790534 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.790629 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.790841 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.790933 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.791153 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.791240 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.791458 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.791576 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.791785 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.791872 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.792087 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.792184 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.792396 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.792506 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.792706 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.792845 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.793001 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.793097 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.793300 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.793405 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.793606 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.793701 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.793923 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.794009 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.794226 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.794321 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.794542 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.794631 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.794857 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.794943 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.795156 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.795244 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.795456 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.795544 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.795797 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.795886 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.796102 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.796190 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.796400 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.796486 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.796700 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.796786 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.796998 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.797130 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.797334 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.797422 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.797639 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.797728 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.797941 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.798030 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.798252 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.798341 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.798567 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.798664 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.798872 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.798966 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.799768 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.799974 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.800057 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.800191 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.800347 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.800508 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.800663 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.800835 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.800973 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.801153 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.801277 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.801465 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.801585 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.801780 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.801891 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.802093 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.802184 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.802406 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.802501 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.802724 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.802871 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.803049 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.803151 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.803363 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.803452 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.803689 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.803791 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.803997 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.804095 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.804298 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.804385 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.804609 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.804704 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.804924 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.805170 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.805486 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.805574 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.805795 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.805894 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.806108 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.806196 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.806425 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.806511 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.806744 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.806840 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.807068 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.807287 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.807383 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.807466 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.807707 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.807801 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.808012 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.808111 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.808317 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.808414 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.808617 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.808706 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.808917 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.809013 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.809219 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.809314 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.809515 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.809602 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.809812 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.809914 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.810113 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.810201 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.810414 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.810500 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.810711 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.810798 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.811012 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.811100 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.811312 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.811401 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.811633 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.811724 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.811939 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.812026 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.812236 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.812322 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.812539 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.812627 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.812840 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.812953 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.813148 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.813259 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.813451 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.813557 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.813748 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.813861 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.814050 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.814157 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.814347 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.814446 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.814671 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.814823 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.815007 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.815237 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.815332 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.815422 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.815656 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.815757 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.815985 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.816092 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.816339 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.816442 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.816578 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.816694 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.816896 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.816994 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.817197 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.817332 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.817497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.817602 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.817798 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.817896 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.818098 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.818186 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.818399 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.818487 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.818696 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.818785 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.818995 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.819081 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.819296 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.819391 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.819620 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.819713 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.819927 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.820026 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.820224 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.820321 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.820526 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.820623 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.820820 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.820914 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.821120 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.821219 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.821423 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.821510 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.821721 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.821809 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.822020 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.822117 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.822321 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.822407 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.822622 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.822717 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.822930 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.823065 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.823228 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.823336 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.823527 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.823653 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.823852 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.823951 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.824151 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.824248 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.824451 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.824556 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.824752 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.824856 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.825054 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.825157 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.825359 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.825457 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.825656 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.825753 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.825958 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.826062 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.826265 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.826390 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.826566 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.826664 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.826864 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.826962 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.827165 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.827281 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.827463 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.827589 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.827787 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.827885 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.828089 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.828237 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.828398 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.828496 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.828708 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.828812 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.829008 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.829115 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.829310 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.829408 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.829607 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.829704 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.829906 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.830010 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.830204 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.830335 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.830557 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.830702 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.830854 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.830968 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.831158 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.831404 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.831537 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.831732 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.831879 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.832037 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.832175 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.832340 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.832486 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.832660 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.832806 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.832968 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.833111 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.833255 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.833426 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.833557 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.833703 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.833840 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.833980 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.834175 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.834313 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.834459 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.834598 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.834817 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.834954 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.835120 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.835266 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.835481 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.835649 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.835781 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.835917 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.836051 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.836186 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.836331 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.836473 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.836643 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.836776 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.836919 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.837055 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.837209 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.837344 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.837520 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.837653 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.837829 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.837975 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.838116 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.838272 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.838418 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.838556 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.838715 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.838865 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.839012 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.839145 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.839314 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.839450 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.839650 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.839796 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.839967 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.840112 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.840284 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.840422 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.840584 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.840732 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.840888 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.841034 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.841196 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.841331 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.841497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.841634 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.841801 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.841941 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.842105 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.842242 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.842411 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.842548 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.842716 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.842852 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.843003 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.843137 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.843313 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.843458 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.843623 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.843768 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.843937 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.844073 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.844238 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.844371 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.844542 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.844679 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.844840 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.844998 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.845156 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.845299 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.845458 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.845596 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.845758 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.846432 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.846615 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.846764 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.846901 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.847037 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.847173 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.847326 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.847462 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.847640 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.847886 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.848025 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.848197 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.848347 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.848507 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.848647 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.848813 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.848951 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.849123 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.849267 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.849435 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.849574 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.849748 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.849891 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.850062 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.850201 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.850363 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.850500 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.850772 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.850917 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.851061 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.851197 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.851366 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.851513 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.851696 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.851828 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.851996 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.852127 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.852294 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.852430 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.852596 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.852741 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.852914 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.853050 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.853194 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.853284 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.853497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.853659 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.853794 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.853927 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.854098 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.854232 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.854401 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.854542 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.854713 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.854852 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.855123 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.855255 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.855426 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.855622 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.855765 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.855903 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.856148 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.856296 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.856457 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.856593 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.856759 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.856870 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.857077 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.857222 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.857390 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.857537 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.857710 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.857845 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.858013 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.858149 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.858319 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.858470 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.858621 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.858759 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.858927 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.859064 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.859243 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.859386 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.859539 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.859698 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.859860 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.860003 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.860161 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.860306 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.860459 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.860597 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.860798 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.860917 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.861091 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.861194 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.861404 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.861493 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.862364 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.862528 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.862770 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.862870 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.863084 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.863173 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.863414 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.863612 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.863769 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.863876 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.864076 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.864174 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.864381 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.864468 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.864689 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.864792 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.864990 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.865077 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.865290 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.865385 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.865607 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.865697 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.865909 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.865998 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.866215 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.866301 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.866518 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.866607 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.866822 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.866911 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.867123 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.867214 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.867422 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.867511 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.867763 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.867906 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.868063 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.868160 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.868381 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.868469 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.868686 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.868776 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.869003 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.869099 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.869316 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.869403 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.869616 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.869702 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.869929 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.870028 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.870233 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.870320 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.870531 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.870619 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.870831 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.870933 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.871130 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.871219 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.871467 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.871571 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.871864 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.871966 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.872181 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.872268 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.872506 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.872592 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.872827 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.872915 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.873134 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.873221 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.873458 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.873581 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.873783 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.873872 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.874097 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.874262 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.874407 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.874505 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.874718 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.874813 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.875037 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.875123 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.875334 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.875421 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.875656 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.875759 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.875963 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.876057 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.876261 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.876357 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.876562 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.876649 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.876861 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.876955 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.877233 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.877384 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.877600 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.877738 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.877904 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.878051 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.878207 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.878352 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.878511 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.878644 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.878813 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.878953 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.879129 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.879277 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.879420 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.879596 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.879744 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.879881 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.880027 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.880174 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.880309 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.880445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.880639 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.880779 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.880943 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.881082 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.881267 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.881412 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.881575 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.881723 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.881896 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.882035 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.882210 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.882349 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.882522 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.882662 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.882836 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.882984 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.883149 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.883288 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.883462 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.883628 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.883795 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.883945 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.884090 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.884228 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.884404 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.884550 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.884716 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.884855 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.885030 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.885166 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.885342 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.885488 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.885854 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.885993 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.886180 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.886577 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.886743 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.886890 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.887054 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.887192 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.887360 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.887499 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.887702 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.887836 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.888011 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.888153 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.888318 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.888455 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.888609 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.888751 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.888912 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.889011 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.889219 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.889307 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.889540 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.889628 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.889859 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.889948 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.890177 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.890277 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.890502 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.890589 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.890812 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.890901 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.891120 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.891218 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.891428 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.891517 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.891763 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.891852 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.892110 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.892217 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.892421 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.892509 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.892723 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.893318 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.893560 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.893793 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.893934 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.894139 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.894302 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.894458 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.894617 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.894776 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.894929 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.895086 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.895242 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.895398 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.895571 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.895734 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.895886 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.896045 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.896195 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.896353 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.896507 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.896662 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.896818 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.896969 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.897142 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.897289 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.897473 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.897618 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.897794 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.897936 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.898106 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.898247 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.898420 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.898559 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.898738 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.898871 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.899257 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.899385 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.899591 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.899724 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.899929 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.900053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.900254 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.900378 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.900576 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.900698 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.900893 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.901011 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.901213 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.901324 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.901539 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.901648 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.901844 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.901941 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.902148 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.902235 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.902457 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.902546 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.902764 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.902860 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.903066 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.903155 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.903385 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.903479 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.903716 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.903817 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.904016 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.904150 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.904332 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.904421 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.904636 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.904727 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.905165 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.905252 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.905504 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.905592 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.905819 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.905910 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.906140 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.906228 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.906462 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.906550 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.906777 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.906865 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.907082 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.907168 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.907402 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.907496 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.907727 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.907825 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.908032 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.908120 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.908349 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.909031 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.909186 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.909395 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.909529 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.909776 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.909923 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.910068 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.910205 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.910374 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.910512 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.910674 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.910819 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.910964 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.911099 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.911263 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.911400 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.911604 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.911762 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.911914 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.912053 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.912190 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.912327 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.912486 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.912628 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.912793 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.912933 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.913094 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.913223 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.913393 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.913535 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.913689 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.913827 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.913986 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.914125 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.914292 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.914411 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.914590 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.914682 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.914896 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.914993 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.915191 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.915291 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.915496 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.915613 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.915832 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.915919 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.916170 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.916260 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.916473 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.916569 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.916775 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.916863 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.917081 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.917170 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.917380 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.917579 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.917667 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.917755 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.917982 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.918080 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.918293 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.918441 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.918581 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.918717 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.918890 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.919030 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.919209 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.919351 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.919528 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.919683 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.919882 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.920074 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.920404 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.920493 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.920723 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.920871 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.921040 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.921176 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.921364 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.921508 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.921667 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.921828 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.921964 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.922101 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.922241 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.922377 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.922557 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.922708 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.922850 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.922994 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.923160 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.923298 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.923466 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.923634 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.923794 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.923932 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.924133 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.924298 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.924442 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.924658 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.924934 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.925072 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.925248 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.925386 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.925562 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.925702 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.925853 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.925987 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.926164 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.926311 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.926470 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.926607 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.926774 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.926912 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.927080 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.927226 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.927389 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.927526 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.927709 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.927806 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.928051 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.928149 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.928365 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.928488 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.928676 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.928770 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.928990 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.929113 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.929303 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.929438 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.929611 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.929699 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.929916 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.930006 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.930221 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.930308 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.930528 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.930615 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.930839 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.930928 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.931148 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.931234 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.931451 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.931571 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.931784 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.932139 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.932444 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.932534 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.932760 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.932863 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.933077 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.933173 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.933385 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.933473 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.933700 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.933801 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.934016 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.934105 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.934324 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.934457 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.934646 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.934734 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.934949 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.935036 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.935267 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.935354 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.935621 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.935738 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.935948 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.936051 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.936267 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.936368 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.936569 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.936669 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.937147 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.937247 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.937450 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.937558 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.937752 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.937850 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.938060 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.938160 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.938364 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.938488 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.938663 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.938770 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.938962 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.939061 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.939275 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.939401 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.939585 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.939683 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.939927 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.940077 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.940232 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.940428 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.940525 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.940736 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.940826 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.941046 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.941143 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.941348 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.941445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.941652 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.941740 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.941954 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.942097 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.942255 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.942345 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.942556 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.942643 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.942854 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.942954 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.943159 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.943246 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.943457 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.943569 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.943783 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.943887 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.944082 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.944170 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.944379 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.944475 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.944679 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.944766 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.945002 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.945090 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.945330 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.945416 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.945638 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.945727 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.945957 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.946043 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.946260 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.946354 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.946578 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.946666 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.946881 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.946968 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.947198 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.947286 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.947512 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.947648 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.947849 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.947957 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.948157 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.948268 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.948485 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.948586 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.948790 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.948895 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.949093 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.949204 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.949400 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.949497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.949705 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.949810 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.950009 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.950117 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.950311 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.950408 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.950629 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.950725 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.950948 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.951055 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.951250 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.951346 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.951589 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.951687 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.951901 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.952000 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.952214 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.952311 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.952525 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.952625 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.952831 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.952930 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.953156 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.953253 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.953461 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.953565 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.953768 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.953874 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.954074 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.954172 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.954380 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.954488 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.954689 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.954786 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.954996 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.955093 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.955835 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.955954 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.956148 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.956318 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.956461 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.956588 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.956772 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.956861 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.957100 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.957191 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.957423 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.957517 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.957725 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.957822 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.958047 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.958155 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.958364 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.958497 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.958763 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.958865 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.959006 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.959094 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.959342 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.959517 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.959693 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.959802 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.960003 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.960103 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.960311 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.960421 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.960610 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.960709 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 00:56:15.960932 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 00:56:15.961025 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 00:56:16.113447 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO dbcounter [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] Registered counter for database nova_api Sep 14 00:56:16.113743 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO dbcounter [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] Registered counter for database nova_api Sep 14 00:56:16.133212 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG oslo_db.sqlalchemy.engines [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105635) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 00:56:16.134920 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_db.sqlalchemy.engines [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 00:56:16.140185 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writer thread running {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 00:56:16.141582 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writer thread running {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 00:56:16.197484 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.context [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),74d3b739-38e2-4172-876a-396cfbc13f8f(cell1) {{(pid=105635) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 00:56:16.198908 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.context [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),74d3b739-38e2-4172-876a-396cfbc13f8f(cell1) {{(pid=105634) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 00:56:16.201429 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG oslo_concurrency.lockutils [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 00:56:16.201905 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG oslo_concurrency.lockutils [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 00:56:16.202781 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 00:56:16.203249 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 00:56:16.203460 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG oslo_concurrency.lockutils [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 00:56:16.204211 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG oslo_concurrency.lockutils [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 00:56:16.204659 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG oslo_concurrency.lockutils [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 00:56:16.204841 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 00:56:16.206346 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 00:56:16.206897 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 00:56:16.207329 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG oslo_concurrency.lockutils [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 00:56:16.208898 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 00:56:16.209353 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO dbcounter [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] Registered counter for database nova_cell0 Sep 14 00:56:16.210878 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO dbcounter [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] Registered counter for database nova_cell0 Sep 14 00:56:16.213351 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO dbcounter [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] Registered counter for database nova_cell1 Sep 14 00:56:16.214936 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO dbcounter [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] Registered counter for database nova_cell1 Sep 14 00:56:16.220585 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG oslo_db.sqlalchemy.engines [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105635) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 00:56:16.222582 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG oslo_db.sqlalchemy.engines [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105635) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 00:56:16.224578 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_db.sqlalchemy.engines [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 00:56:16.228259 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_db.sqlalchemy.engines [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 00:56:16.230542 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writer thread running {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 00:56:16.230883 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writer thread running {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 00:56:16.230979 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writer thread running {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 00:56:16.372206 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writer thread running {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 00:56:16.380730 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO dbcounter [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] Registered counter for database nova_cell0 Sep 14 00:56:16.381841 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO dbcounter [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] Registered counter for database nova_cell0 Sep 14 00:56:16.390002 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG oslo_db.sqlalchemy.engines [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105635) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 00:56:16.394008 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_db.sqlalchemy.engines [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 00:56:16.395743 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writer thread running {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 00:56:16.398709 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writer thread running {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 00:56:16.736951 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: WARNING keystonemiddleware.auth_token [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 00:56:16.737901 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: WARNING keystonemiddleware.auth_token [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 00:56:16.744241 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: WARNING keystonemiddleware.auth_token [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 00:56:16.745226 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: WARNING keystonemiddleware.auth_token [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 00:56:17.087664 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: WARNING keystonemiddleware.auth_token [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 00:56:17.089836 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: WARNING keystonemiddleware.auth_token [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 00:56:17.093583 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: WARNING keystonemiddleware.auth_token [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 00:56:17.095763 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: WARNING keystonemiddleware.auth_token [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 00:56:17.099235 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e18a10a9c0 pid: 105635 (default app) Sep 14 00:56:17.101109 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e18a10a9c0 pid: 105634 (default app) Sep 14 00:56:17.101342 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:56:17.102523 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-d1fb8734-e8e8-4fb9-a416-7bb6562a99dc None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001711 Sep 14 00:56:17.102943 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Wed Sep 14 00:56:17 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:57:38.764184 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:57:38.765330 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002637 Sep 14 00:57:38.765913 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 00:57:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:57:38.777239 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writing DB stats nova_api:SELECT=3 {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:38.782419 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writing DB stats nova_cell0:SELECT=3 {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:38.783186 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writing DB stats nova_cell1:SELECT=3 {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:38.785192 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:39.665665 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-a06bdd2c-c1ec-4afb-b164-54d02756bdcb admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:57:39.699487 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-a06bdd2c-c1ec-4afb-b164-54d02756bdcb admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.927496 Sep 14 00:57:39.701080 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 2/3] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Sep 14 00:57:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 00:57:42.331702 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:57:42.332729 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-c80a56da-ce1e-45bf-86bd-308bb7b98d45 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 14 00:57:42.333140 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 2/4] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 00:57:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 00:57:42.798812 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-f5430a2f-226f-4660-b7ce-8a5787281310 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "c1", "disk": 1, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "swap": 0}} {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:57:42.850831 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-f5430a2f-226f-4660-b7ce-8a5787281310 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.511613 Sep 14 00:57:42.851616 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 3/5] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Sep 14 00:57:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 00:57:42.865016 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_api:SELECT=3 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:42.867110 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_cell0:SELECT=3 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:42.867925 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_cell1:SELECT=3 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:42.868948 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:57:43.077150 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-cb8d306d-5745-487e-a265-816c05de797f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:57:43.145778 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-cb8d306d-5745-487e-a265-816c05de797f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285847 Sep 14 00:57:43.146558 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 3/6] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Sep 14 00:57:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 00:57:45.804003 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-f5430a2f-226f-4660-b7ce-8a5787281310 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:57:45.805630 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-f5430a2f-226f-4660-b7ce-8a5787281310 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002106 Sep 14 00:57:45.806183 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 4/7] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 00:57:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:57:46.467243 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-977c005e-7d07-49ad-92fb-071338b6cb59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "disk": 5, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "vcpus": 1}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:57:46.510166 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-977c005e-7d07-49ad-92fb-071338b6cb59 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.697052 Sep 14 00:57:46.510927 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 4/8] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Sep 14 00:57:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 00:57:46.525698 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-90bf07f8-4eee-471b-a07f-63ab74006c4c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:57:46.573297 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-90bf07f8-4eee-471b-a07f-63ab74006c4c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052550 Sep 14 00:57:46.575592 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 5/9] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Sep 14 00:57:46 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 00:57:49.198131 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-977c005e-7d07-49ad-92fb-071338b6cb59 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:57:49.199161 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-977c005e-7d07-49ad-92fb-071338b6cb59 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 14 00:57:49.200305 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 00:57:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:57:49.634441 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-5dc2f235-0990-4ce0-bc8c-923475cbea63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "ram": 1024, "name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:57:49.653573 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-5dc2f235-0990-4ce0-bc8c-923475cbea63 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.445798 Sep 14 00:57:49.654128 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 6/11] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Sep 14 00:57:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 00:57:49.666434 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-89fa48a5-48f2-45a9-93fc-5d57b29ebb26 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:57:49.702678 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-89fa48a5-48f2-45a9-93fc-5d57b29ebb26 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039892 Sep 14 00:57:49.703579 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 6/12] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Sep 14 00:57:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 00:57:52.378301 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-5dc2f235-0990-4ce0-bc8c-923475cbea63 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:57:52.379320 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-5dc2f235-0990-4ce0-bc8c-923475cbea63 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 14 00:57:52.379756 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 7/13] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 00:57:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:57:52.814111 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-d782b03f-8940-4761-b179-ce59b9b04ccf admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "disk": 10, "ram": 2048, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:57:52.836903 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-d782b03f-8940-4761-b179-ce59b9b04ccf admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.450356 Sep 14 00:57:52.839660 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 7/14] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Sep 14 00:57:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 00:57:52.850538 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-9473eca0-27a6-4147-8a53-fe5c1e5fa7e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:57:52.880990 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-9473eca0-27a6-4147-8a53-fe5c1e5fa7e9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034150 Sep 14 00:57:52.894158 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 8/15] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Sep 14 00:57:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 00:57:55.566138 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-d782b03f-8940-4761-b179-ce59b9b04ccf admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:57:55.567518 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-d782b03f-8940-4761-b179-ce59b9b04ccf admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001931 Sep 14 00:57:55.568119 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 8/16] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 00:57:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:57:56.032652 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-9211b690-af05-4583-b8ca-9a44f180ed9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:57:56.052954 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-9211b690-af05-4583-b8ca-9a44f180ed9d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.476994 Sep 14 00:57:56.053578 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 9/17] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Sep 14 00:57:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 00:57:56.071143 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-e9ba53bd-5044-415f-91c6-dff77f149e71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:57:56.098444 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-e9ba53bd-5044-415f-91c6-dff77f149e71 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030934 Sep 14 00:57:56.099020 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 9/18] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Sep 14 00:57:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 00:57:58.821210 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-9211b690-af05-4583-b8ca-9a44f180ed9d admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:57:58.822446 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-9211b690-af05-4583-b8ca-9a44f180ed9d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001942 Sep 14 00:57:58.822980 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 10/19] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 00:57:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:57:59.254487 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-95b30f7c-a357-4408-8ab0-92b6d1958722 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:57:59.280799 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-95b30f7c-a357-4408-8ab0-92b6d1958722 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.449807 Sep 14 00:57:59.281356 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 10/20] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Sep 14 00:57:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 00:58:01.904429 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-9211b690-af05-4583-b8ca-9a44f180ed9d admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:01.905362 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-9211b690-af05-4583-b8ca-9a44f180ed9d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 14 00:58:01.905770 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 11/21] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 00:58:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 00:58:02.300937 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-b4c3ab4e-299b-4a6f-a98c-6e6bf8186741 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 1, "id": "1", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny"}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:58:02.322079 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-b4c3ab4e-299b-4a6f-a98c-6e6bf8186741 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.410290 Sep 14 00:58:02.322624 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 11/22] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Sep 14 00:58:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 00:58:02.334786 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-2f05e9a1-4ea3-424c-985f-f4836591170b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:58:02.363678 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-2f05e9a1-4ea3-424c-985f-f4836591170b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032526 Sep 14 00:58:02.364353 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 12/23] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Sep 14 00:58:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 00:58:04.987794 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-b4c3ab4e-299b-4a6f-a98c-6e6bf8186741 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:04.988803 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-b4c3ab4e-299b-4a6f-a98c-6e6bf8186741 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 14 00:58:04.989208 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 12/24] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 00:58:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:58:05.411661 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-85c30355-ba63-4578-bee1-d15eed90ffb3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.small", "disk": 20, "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "id": "2"}} {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:58:05.435094 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-85c30355-ba63-4578-bee1-d15eed90ffb3 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.438454 Sep 14 00:58:05.436513 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 13/25] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Sep 14 00:58:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 00:58:05.450208 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-fdb583a3-64d1-4a07-b87f-df7ea8c5bb35 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:58:05.478632 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-fdb583a3-64d1-4a07-b87f-df7ea8c5bb35 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033256 Sep 14 00:58:05.483989 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 13/26] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Sep 14 00:58:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 00:58:08.148510 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-85c30355-ba63-4578-bee1-d15eed90ffb3 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:08.150126 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-85c30355-ba63-4578-bee1-d15eed90ffb3 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002181 Sep 14 00:58:08.150600 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 14/27] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 00:58:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:58:08.691280 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-d58457a3-ad88-4367-8a40-e56e379aa146 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "id": "3", "vcpus": 2, "disk": 40, "os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:58:08.717969 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-d58457a3-ad88-4367-8a40-e56e379aa146 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.559085 Sep 14 00:58:08.719131 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 14/28] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Sep 14 00:58:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 00:58:08.731656 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-03867c21-835f-412a-92e8-7cf7ded19082 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:58:08.765796 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-03867c21-835f-412a-92e8-7cf7ded19082 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038342 Sep 14 00:58:08.767529 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 15/29] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Sep 14 00:58:08 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 00:58:11.417835 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-d58457a3-ad88-4367-8a40-e56e379aa146 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:11.418850 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-d58457a3-ad88-4367-8a40-e56e379aa146 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002169 Sep 14 00:58:11.419251 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 15/30] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 00:58:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:58:11.872115 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-2aa8928e-cd10-4246-8577-6cb2afe9b461 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "name": "m1.large", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "ram": 8192}} {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:58:11.878307 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:11.895077 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-2aa8928e-cd10-4246-8577-6cb2afe9b461 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.469599 Sep 14 00:58:11.895909 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 16/31] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Sep 14 00:58:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 00:58:11.908711 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-8dbb0fe4-8cda-4f84-a2bf-3b495559ef0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:58:11.935915 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-8dbb0fe4-8cda-4f84-a2bf-3b495559ef0e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027895 Sep 14 00:58:11.937076 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 16/32] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Sep 14 00:58:11 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 00:58:14.575487 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-2aa8928e-cd10-4246-8577-6cb2afe9b461 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:14.576543 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-2aa8928e-cd10-4246-8577-6cb2afe9b461 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 14 00:58:14.576946 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 17/33] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 00:58:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:58:15.031990 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-223d7287-ea42-444e-a5b5-786751161866 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "id": "5", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:58:15.039453 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:15.056476 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-223d7287-ea42-444e-a5b5-786751161866 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.473193 Sep 14 00:58:15.057254 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 17/34] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Sep 14 00:58:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 00:58:15.069512 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-51735f7e-46f6-49c7-9555-5e0f19af556f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:58:15.097584 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-51735f7e-46f6-49c7-9555-5e0f19af556f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031893 Sep 14 00:58:15.098278 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 18/35] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Sep 14 00:58:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 00:58:32.004614 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-223d7287-ea42-444e-a5b5-786751161866 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:32.005635 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-223d7287-ea42-444e-a5b5-786751161866 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 14 00:58:32.006039 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 18/36] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 00:58:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:58:32.016963 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:58:32.409137 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-aca7c624-0db5-47d8-af6f-5937303f9d6e admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:32.427601 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-aca7c624-0db5-47d8-af6f-5937303f9d6e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.415065 Sep 14 00:58:32.428138 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 19/37] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Sep 14 00:58:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 00:58:33.742948 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-223d7287-ea42-444e-a5b5-786751161866 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:33.743980 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-223d7287-ea42-444e-a5b5-786751161866 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Sep 14 00:58:33.744369 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 19/38] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 00:58:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:58:34.278604 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-3c339b7c-67d3-4179-84b7-4b422183b310 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:34.283916 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.wsgi [None req-3c339b7c-67d3-4179-84b7-4b422183b310 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-3c339b7c-67d3-4179-84b7-4b422183b310 admin admin] Request method failure captured: Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Accept: application/json Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Accept-Encoding: gzip, deflate Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Connection: keep-alive Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Content-Length: 0 Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Host: 10.222.0.42 Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Openstack-Api-Version: compute 2.92 Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Openstack-System-Scope: None Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: User-Agent: python-novaclient Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Auth-Token: gAAAAABjISc5ynHViA7Xqtz2k3rM5GhK_iRhlF83DDo-1tC4KrV1dohq5f0W-rkO-hn3Z_g7aX5aXllE3b6evZTni5nno7ANnJ-CxmFP9f1icyf6ACj6GZvU_jU0aPl2xMxcGpabvCnUusTKryX9-NuQhhRyI3MNc8TzyzcBNa_B0LHnaiqdzoY Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Domain-Id: None Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Domain-Name: None Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Identity-Status: Confirmed Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Is-Admin-Project: True Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Project-Domain-Id: default Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Project-Domain-Name: Default Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Project-Id: 724534edd35a41c585d8ed624130e96a Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Project-Name: admin Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Role: reader,admin,member Sep 14 00:58:34.287129 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Roles: reader,admin,member Sep 14 00:58:34.288819 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724534edd35a41c585d8ed624130e96a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/724534edd35a41c585d8ed624130e96a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724534edd35a41c585d8ed624130e96a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_724534edd35a41c585d8ed624130e96a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 00:58:34.288819 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Tenant: admin Sep 14 00:58:34.288819 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Tenant-Id: 724534edd35a41c585d8ed624130e96a Sep 14 00:58:34.288819 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Tenant-Name: admin Sep 14 00:58:34.288819 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-User: admin Sep 14 00:58:34.288819 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-User-Domain-Id: default Sep 14 00:58:34.288819 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-User-Domain-Name: Default Sep 14 00:58:34.288819 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-User-Id: 9dea2911925e405b852c2fe0f9bee81d Sep 14 00:58:34.288819 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-User-Name: admin Sep 14 00:58:34.288819 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: method: > Sep 14 00:58:34.288819 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: exception: Flavor 42 could not be found. Sep 14 00:58:34.288819 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: action_args: {'id': '42'} Sep 14 00:58:34.288819 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 00:58:34.288819 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 00:58:34.289736 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 00:58:34.289736 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 00:58:34.289736 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 00:58:34.289736 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 00:58:34.289736 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 00:58:34.289736 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 00:58:34.289736 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 00:58:34.289736 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 00:58:34.289736 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 00:58:34.289736 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 00:58:34.289736 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 00:58:34.289736 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 00:58:34.289736 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 14 00:58:34.289736 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Sep 14 00:58:34.289736 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 00:58:34.289736 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Sep 14 00:58:34.289736 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 00:58:34.289736 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 00:58:34.289736 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 00:58:34.291158 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 00:58:34.291158 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 00:58:34.291158 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 00:58:34.291158 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 00:58:34.291158 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 00:58:34.291158 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 00:58:34.291158 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 14 00:58:34.291158 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Sep 14 00:58:34.291158 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 00:58:34.291158 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Sep 14 00:58:34.291158 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 00:58:34.291158 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 00:58:34.291158 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 00:58:34.291158 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 00:58:34.291158 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 00:58:34.291158 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 14 00:58:34.291158 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Sep 14 00:58:34.291158 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-3c339b7c-67d3-4179-84b7-4b422183b310 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105635) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 00:58:34.292902 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-3c339b7c-67d3-4179-84b7-4b422183b310 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.396638 Sep 14 00:58:34.292902 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 20/39] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Sep 14 00:58:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:34.299436 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-f489d930-68a6-403f-bfe4-8e97d8d871c5 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:34.322491 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-f489d930-68a6-403f-bfe4-8e97d8d871c5 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027565 Sep 14 00:58:34.323030 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 20/40] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Sep 14 00:58:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 00:58:34.334285 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-16ea9b46-81a9-44c3-af96-610f82d80be7 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:34.356231 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-16ea9b46-81a9-44c3-af96-610f82d80be7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026399 Sep 14 00:58:34.356774 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 21/41] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Sep 14 00:58:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 00:58:34.366068 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-7f70708a-3ede-4ebd-8b69-fa3afdd6d9c4 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:34.372200 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.wsgi [None req-7f70708a-3ede-4ebd-8b69-fa3afdd6d9c4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-7f70708a-3ede-4ebd-8b69-fa3afdd6d9c4 admin admin] Request method failure captured: Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Accept: application/json Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Accept-Encoding: gzip, deflate Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Connection: keep-alive Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Content-Length: 0 Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Host: 10.222.0.42 Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Openstack-Api-Version: compute 2.92 Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Openstack-System-Scope: None Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: User-Agent: python-novaclient Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Auth-Token: gAAAAABjISc5ynHViA7Xqtz2k3rM5GhK_iRhlF83DDo-1tC4KrV1dohq5f0W-rkO-hn3Z_g7aX5aXllE3b6evZTni5nno7ANnJ-CxmFP9f1icyf6ACj6GZvU_jU0aPl2xMxcGpabvCnUusTKryX9-NuQhhRyI3MNc8TzyzcBNa_B0LHnaiqdzoY Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Domain-Id: None Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Domain-Name: None Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Identity-Status: Confirmed Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Is-Admin-Project: True Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Project-Domain-Id: default Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Project-Domain-Name: Default Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Project-Id: 724534edd35a41c585d8ed624130e96a Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Project-Name: admin Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Role: reader,admin,member Sep 14 00:58:34.375497 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Roles: reader,admin,member Sep 14 00:58:34.376920 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724534edd35a41c585d8ed624130e96a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/724534edd35a41c585d8ed624130e96a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724534edd35a41c585d8ed624130e96a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_724534edd35a41c585d8ed624130e96a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 00:58:34.376920 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Tenant: admin Sep 14 00:58:34.376920 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Tenant-Id: 724534edd35a41c585d8ed624130e96a Sep 14 00:58:34.376920 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Tenant-Name: admin Sep 14 00:58:34.376920 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-User: admin Sep 14 00:58:34.376920 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-User-Domain-Id: default Sep 14 00:58:34.376920 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-User-Domain-Name: Default Sep 14 00:58:34.376920 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-User-Id: 9dea2911925e405b852c2fe0f9bee81d Sep 14 00:58:34.376920 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-User-Name: admin Sep 14 00:58:34.376920 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: method: > Sep 14 00:58:34.376920 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: exception: Flavor 42 could not be found. Sep 14 00:58:34.376920 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: action_args: {'id': '42'} Sep 14 00:58:34.376920 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 00:58:34.376920 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 00:58:34.377765 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 00:58:34.377765 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 00:58:34.377765 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 00:58:34.377765 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 00:58:34.377765 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 00:58:34.377765 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 00:58:34.377765 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 00:58:34.377765 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 00:58:34.377765 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 00:58:34.377765 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 00:58:34.377765 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 00:58:34.377765 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 00:58:34.377765 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 14 00:58:34.377765 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 14 00:58:34.377765 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 00:58:34.377765 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 14 00:58:34.377765 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 00:58:34.377765 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 00:58:34.377765 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 00:58:34.379111 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 00:58:34.379111 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 00:58:34.379111 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 00:58:34.379111 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 00:58:34.379111 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 00:58:34.379111 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 00:58:34.379111 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 14 00:58:34.379111 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 14 00:58:34.379111 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 00:58:34.379111 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 14 00:58:34.379111 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 00:58:34.379111 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 00:58:34.379111 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 00:58:34.379111 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 00:58:34.379111 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 00:58:34.379111 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 14 00:58:34.379111 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 14 00:58:34.379111 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-7f70708a-3ede-4ebd-8b69-fa3afdd6d9c4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 00:58:34.380400 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-7f70708a-3ede-4ebd-8b69-fa3afdd6d9c4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014358 Sep 14 00:58:34.380400 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 21/42] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Sep 14 00:58:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:35.593363 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-16ea9b46-81a9-44c3-af96-610f82d80be7 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:35.594373 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-16ea9b46-81a9-44c3-af96-610f82d80be7 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 14 00:58:35.594772 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 22/43] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 00:58:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:58:36.121836 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-846dd073-959f-455b-851b-0e804510b325 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:36.126882 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.wsgi [None req-846dd073-959f-455b-851b-0e804510b325 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-846dd073-959f-455b-851b-0e804510b325 admin admin] Request method failure captured: Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Accept: application/json Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Accept-Encoding: gzip, deflate Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Connection: keep-alive Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Content-Length: 0 Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Host: 10.222.0.42 Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Openstack-Api-Version: compute 2.92 Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Openstack-System-Scope: None Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: User-Agent: python-novaclient Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Auth-Token: gAAAAABjISc7cT4gvkb2Lpx-KzyfIP4AE5fxMVnK44qXIlSLg1OhduyySrj9VxPfUr544OSi8gHhaBDpY9NEgHtJF-_G3hmDHQAJvYn9_Kfe9d8WdOIiStW0uG7ku7ff3St41YXVFDu_f36BZzdTigtHyGpEMPgCzOvW7LuKSnLnQEh1YZwMAM0 Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Domain-Id: None Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Domain-Name: None Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Identity-Status: Confirmed Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Is-Admin-Project: True Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Project-Domain-Id: default Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Project-Domain-Name: Default Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Project-Id: 724534edd35a41c585d8ed624130e96a Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Project-Name: admin Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Role: reader,admin,member Sep 14 00:58:36.129053 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Roles: reader,admin,member Sep 14 00:58:36.130560 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724534edd35a41c585d8ed624130e96a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/724534edd35a41c585d8ed624130e96a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724534edd35a41c585d8ed624130e96a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_724534edd35a41c585d8ed624130e96a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 00:58:36.130560 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Tenant: admin Sep 14 00:58:36.130560 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Tenant-Id: 724534edd35a41c585d8ed624130e96a Sep 14 00:58:36.130560 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Tenant-Name: admin Sep 14 00:58:36.130560 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-User: admin Sep 14 00:58:36.130560 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-User-Domain-Id: default Sep 14 00:58:36.130560 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-User-Domain-Name: Default Sep 14 00:58:36.130560 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-User-Id: 9dea2911925e405b852c2fe0f9bee81d Sep 14 00:58:36.130560 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-User-Name: admin Sep 14 00:58:36.130560 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: method: > Sep 14 00:58:36.130560 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: exception: Flavor 84 could not be found. Sep 14 00:58:36.130560 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: action_args: {'id': '84'} Sep 14 00:58:36.130560 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 00:58:36.130560 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 00:58:36.131382 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 00:58:36.131382 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 00:58:36.131382 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 00:58:36.131382 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 00:58:36.131382 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 00:58:36.131382 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 00:58:36.131382 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 00:58:36.131382 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 00:58:36.131382 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 00:58:36.131382 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 00:58:36.131382 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 00:58:36.131382 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 00:58:36.131382 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 14 00:58:36.131382 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 14 00:58:36.131382 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 00:58:36.131382 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 14 00:58:36.131382 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 00:58:36.131382 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 00:58:36.131382 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 00:58:36.132748 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 00:58:36.132748 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 00:58:36.132748 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 00:58:36.132748 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 00:58:36.132748 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 00:58:36.132748 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 00:58:36.132748 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 14 00:58:36.132748 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 14 00:58:36.132748 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 00:58:36.132748 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 14 00:58:36.132748 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 00:58:36.132748 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 00:58:36.132748 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 00:58:36.132748 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 00:58:36.132748 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 00:58:36.132748 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 14 00:58:36.132748 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 14 00:58:36.132748 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-846dd073-959f-455b-851b-0e804510b325 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 00:58:36.133976 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-846dd073-959f-455b-851b-0e804510b325 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.397995 Sep 14 00:58:36.133976 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 22/44] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Sep 14 00:58:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:36.141477 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-7323003d-5322-4967-aefd-3a65c2f9877a admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:36.157080 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-7323003d-5322-4967-aefd-3a65c2f9877a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019129 Sep 14 00:58:36.157612 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 23/45] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Sep 14 00:58:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 00:58:36.166871 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-4fe2178d-bd80-4e16-b20e-ca0bc34fdc96 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:36.182044 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-4fe2178d-bd80-4e16-b20e-ca0bc34fdc96 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018705 Sep 14 00:58:36.182557 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 23/46] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Sep 14 00:58:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 00:58:36.191819 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-d0bba94a-8110-4be6-9972-89077508d45f admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:36.196796 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.wsgi [None req-d0bba94a-8110-4be6-9972-89077508d45f admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-d0bba94a-8110-4be6-9972-89077508d45f admin admin] Request method failure captured: Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Accept: application/json Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Accept-Encoding: gzip, deflate Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Connection: keep-alive Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Content-Length: 0 Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Host: 10.222.0.42 Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Openstack-Api-Version: compute 2.92 Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Openstack-System-Scope: None Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: User-Agent: python-novaclient Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Auth-Token: gAAAAABjISc7cT4gvkb2Lpx-KzyfIP4AE5fxMVnK44qXIlSLg1OhduyySrj9VxPfUr544OSi8gHhaBDpY9NEgHtJF-_G3hmDHQAJvYn9_Kfe9d8WdOIiStW0uG7ku7ff3St41YXVFDu_f36BZzdTigtHyGpEMPgCzOvW7LuKSnLnQEh1YZwMAM0 Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Domain-Id: None Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Domain-Name: None Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Identity-Status: Confirmed Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Is-Admin-Project: True Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Project-Domain-Id: default Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Project-Domain-Name: Default Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Project-Id: 724534edd35a41c585d8ed624130e96a Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Project-Name: admin Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Role: reader,admin,member Sep 14 00:58:36.198904 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Roles: reader,admin,member Sep 14 00:58:36.201088 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724534edd35a41c585d8ed624130e96a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/724534edd35a41c585d8ed624130e96a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724534edd35a41c585d8ed624130e96a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_724534edd35a41c585d8ed624130e96a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 00:58:36.201088 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Tenant: admin Sep 14 00:58:36.201088 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Tenant-Id: 724534edd35a41c585d8ed624130e96a Sep 14 00:58:36.201088 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Tenant-Name: admin Sep 14 00:58:36.201088 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-User: admin Sep 14 00:58:36.201088 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-User-Domain-Id: default Sep 14 00:58:36.201088 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-User-Domain-Name: Default Sep 14 00:58:36.201088 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-User-Id: 9dea2911925e405b852c2fe0f9bee81d Sep 14 00:58:36.201088 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-User-Name: admin Sep 14 00:58:36.201088 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: method: > Sep 14 00:58:36.201088 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: exception: Flavor 84 could not be found. Sep 14 00:58:36.201088 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: action_args: {'id': '84'} Sep 14 00:58:36.201088 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 00:58:36.201088 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 00:58:36.202019 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 00:58:36.202019 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 00:58:36.202019 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 00:58:36.202019 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 00:58:36.202019 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 00:58:36.202019 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 00:58:36.202019 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 00:58:36.202019 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 00:58:36.202019 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 00:58:36.202019 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 00:58:36.202019 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 00:58:36.202019 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 00:58:36.202019 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 14 00:58:36.202019 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Sep 14 00:58:36.202019 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 00:58:36.202019 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Sep 14 00:58:36.202019 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 00:58:36.202019 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 00:58:36.202019 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 00:58:36.203135 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 00:58:36.203135 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 00:58:36.203135 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 00:58:36.203135 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 00:58:36.203135 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 00:58:36.203135 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 00:58:36.203135 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 14 00:58:36.203135 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Sep 14 00:58:36.203135 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 00:58:36.203135 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Sep 14 00:58:36.203135 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 00:58:36.203135 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 00:58:36.203135 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 00:58:36.203135 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 00:58:36.203135 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 00:58:36.203135 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 14 00:58:36.203135 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Sep 14 00:58:36.203135 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-d0bba94a-8110-4be6-9972-89077508d45f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105635) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 00:58:36.204212 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-d0bba94a-8110-4be6-9972-89077508d45f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012121 Sep 14 00:58:36.204212 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 24/47] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Sep 14 00:58:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:37.417767 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-4fe2178d-bd80-4e16-b20e-ca0bc34fdc96 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:37.418808 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-4fe2178d-bd80-4e16-b20e-ca0bc34fdc96 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002050 Sep 14 00:58:37.419204 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 24/48] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 00:58:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:58:37.945641 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-d683d5c6-5ac7-4f6f-b0d1-e5ed23ac1655 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:37.951911 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.wsgi [None req-d683d5c6-5ac7-4f6f-b0d1-e5ed23ac1655 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-d683d5c6-5ac7-4f6f-b0d1-e5ed23ac1655 admin admin] Request method failure captured: Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Accept: application/json Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Accept-Encoding: gzip, deflate Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Connection: keep-alive Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Content-Length: 0 Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Host: 10.222.0.42 Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Openstack-Api-Version: compute 2.92 Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Openstack-System-Scope: None Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: User-Agent: python-novaclient Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Auth-Token: gAAAAABjISc9WZHVPHNwrpdo-yfh9rt0hnCv3HNbxfgiEGQR7UcwMWt4JmT5Qo7b4pVkI9gZOYmIk5_eKwGUruxySNpebMsm2aUxpSO0Ir3kQ1l9KRYie0fzfqMLBrwy1agJHeR53Ro7NdjfQMvMZrWf7N3lWb1YVenfBWb3M31rgeithVQbT6U Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Domain-Id: None Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Domain-Name: None Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Identity-Status: Confirmed Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Is-Admin-Project: True Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Project-Domain-Id: default Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Project-Domain-Name: Default Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Project-Id: 724534edd35a41c585d8ed624130e96a Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Project-Name: admin Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Role: reader,admin,member Sep 14 00:58:37.953445 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Roles: reader,admin,member Sep 14 00:58:37.955014 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724534edd35a41c585d8ed624130e96a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/724534edd35a41c585d8ed624130e96a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724534edd35a41c585d8ed624130e96a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_724534edd35a41c585d8ed624130e96a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 00:58:37.955014 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Tenant: admin Sep 14 00:58:37.955014 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Tenant-Id: 724534edd35a41c585d8ed624130e96a Sep 14 00:58:37.955014 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-Tenant-Name: admin Sep 14 00:58:37.955014 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-User: admin Sep 14 00:58:37.955014 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-User-Domain-Id: default Sep 14 00:58:37.955014 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-User-Domain-Name: Default Sep 14 00:58:37.955014 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-User-Id: 9dea2911925e405b852c2fe0f9bee81d Sep 14 00:58:37.955014 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: X-User-Name: admin Sep 14 00:58:37.955014 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: method: > Sep 14 00:58:37.955014 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: exception: Flavor 451 could not be found. Sep 14 00:58:37.955014 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: action_args: {'id': '451'} Sep 14 00:58:37.955014 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 00:58:37.955014 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 00:58:37.956096 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 00:58:37.956096 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 00:58:37.956096 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 00:58:37.956096 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 00:58:37.956096 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 00:58:37.956096 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 00:58:37.956096 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 00:58:37.956096 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 00:58:37.956096 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 00:58:37.956096 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 00:58:37.956096 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 00:58:37.956096 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 00:58:37.956096 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 14 00:58:37.956096 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Sep 14 00:58:37.956096 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 00:58:37.956096 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Sep 14 00:58:37.956096 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 00:58:37.956096 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 00:58:37.956096 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 00:58:37.957437 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 00:58:37.957437 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 00:58:37.957437 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 00:58:37.957437 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 00:58:37.957437 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 00:58:37.957437 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 00:58:37.957437 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 14 00:58:37.957437 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Sep 14 00:58:37.957437 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 00:58:37.957437 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Sep 14 00:58:37.957437 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 00:58:37.957437 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 00:58:37.957437 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 00:58:37.957437 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 00:58:37.957437 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 00:58:37.957437 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 14 00:58:37.957437 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: ERROR nova.api.openstack.wsgi Sep 14 00:58:37.957437 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-d683d5c6-5ac7-4f6f-b0d1-e5ed23ac1655 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105635) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 00:58:37.958726 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-d683d5c6-5ac7-4f6f-b0d1-e5ed23ac1655 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.397509 Sep 14 00:58:37.958726 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 25/49] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Sep 14 00:58:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:37.965349 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-589d939a-204c-41fc-b573-afce0956d7a8 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:37.980222 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-589d939a-204c-41fc-b573-afce0956d7a8 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018797 Sep 14 00:58:37.980742 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 25/50] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Sep 14 00:58:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 00:58:37.990932 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-f6dc754f-f5b7-436c-bb2e-11ce2108752a admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:38.005732 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-f6dc754f-f5b7-436c-bb2e-11ce2108752a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018322 Sep 14 00:58:38.006255 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 26/51] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Sep 14 00:58:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 00:58:38.016039 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-f9ac1145-9289-40aa-8661-d9032a516d47 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:38.026341 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.wsgi [None req-f9ac1145-9289-40aa-8661-d9032a516d47 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-f9ac1145-9289-40aa-8661-d9032a516d47 admin admin] Request method failure captured: Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Accept: application/json Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Accept-Encoding: gzip, deflate Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Connection: keep-alive Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Content-Length: 0 Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Host: 10.222.0.42 Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Openstack-Api-Version: compute 2.92 Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Openstack-System-Scope: None Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: User-Agent: python-novaclient Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Auth-Token: gAAAAABjISc9WZHVPHNwrpdo-yfh9rt0hnCv3HNbxfgiEGQR7UcwMWt4JmT5Qo7b4pVkI9gZOYmIk5_eKwGUruxySNpebMsm2aUxpSO0Ir3kQ1l9KRYie0fzfqMLBrwy1agJHeR53Ro7NdjfQMvMZrWf7N3lWb1YVenfBWb3M31rgeithVQbT6U Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Domain-Id: None Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Domain-Name: None Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Identity-Status: Confirmed Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Is-Admin-Project: True Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Project-Domain-Id: default Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Project-Domain-Name: Default Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Project-Id: 724534edd35a41c585d8ed624130e96a Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Project-Name: admin Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Role: reader,admin,member Sep 14 00:58:38.028535 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Roles: reader,admin,member Sep 14 00:58:38.030258 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724534edd35a41c585d8ed624130e96a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/724534edd35a41c585d8ed624130e96a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724534edd35a41c585d8ed624130e96a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_724534edd35a41c585d8ed624130e96a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 00:58:38.030258 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Tenant: admin Sep 14 00:58:38.030258 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Tenant-Id: 724534edd35a41c585d8ed624130e96a Sep 14 00:58:38.030258 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-Tenant-Name: admin Sep 14 00:58:38.030258 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-User: admin Sep 14 00:58:38.030258 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-User-Domain-Id: default Sep 14 00:58:38.030258 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-User-Domain-Name: Default Sep 14 00:58:38.030258 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-User-Id: 9dea2911925e405b852c2fe0f9bee81d Sep 14 00:58:38.030258 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: X-User-Name: admin Sep 14 00:58:38.030258 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: method: > Sep 14 00:58:38.030258 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: exception: Flavor 451 could not be found. Sep 14 00:58:38.030258 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: action_args: {'id': '451'} Sep 14 00:58:38.030258 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 00:58:38.030258 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 00:58:38.031264 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 00:58:38.031264 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 00:58:38.031264 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 00:58:38.031264 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 00:58:38.031264 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 00:58:38.031264 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 00:58:38.031264 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 00:58:38.031264 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 00:58:38.031264 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 00:58:38.031264 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 00:58:38.031264 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 00:58:38.031264 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 00:58:38.031264 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 14 00:58:38.031264 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 14 00:58:38.031264 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 00:58:38.031264 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 14 00:58:38.031264 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 00:58:38.031264 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 00:58:38.031264 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 00:58:38.032604 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 00:58:38.032604 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 00:58:38.032604 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 00:58:38.032604 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 00:58:38.032604 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 00:58:38.032604 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 00:58:38.032604 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 14 00:58:38.032604 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 14 00:58:38.032604 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 00:58:38.032604 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 14 00:58:38.032604 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 00:58:38.032604 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 00:58:38.032604 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 00:58:38.032604 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 00:58:38.032604 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 00:58:38.032604 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 14 00:58:38.032604 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: ERROR nova.api.openstack.wsgi Sep 14 00:58:38.032604 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-f9ac1145-9289-40aa-8661-d9032a516d47 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 00:58:38.033850 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-f9ac1145-9289-40aa-8661-d9032a516d47 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.017302 Sep 14 00:58:38.033850 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 26/52] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Sep 14 00:58:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 00:58:39.266778 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-f6dc754f-f5b7-436c-bb2e-11ce2108752a admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:39.267817 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-f6dc754f-f5b7-436c-bb2e-11ce2108752a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 14 00:58:39.268212 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 27/53] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 00:58:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:58:39.795059 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-5a01e75c-e28b-4570-9bc7-03f3514db361 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:58:39.815212 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-5a01e75c-e28b-4570-9bc7-03f3514db361 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.406096 Sep 14 00:58:39.815784 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 27/54] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Sep 14 00:58:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 00:58:41.038803 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-f6dc754f-f5b7-436c-bb2e-11ce2108752a admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:41.039855 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-f6dc754f-f5b7-436c-bb2e-11ce2108752a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 14 00:58:41.040259 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 00:58:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:58:41.565098 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-618eab35-6682-4b0e-860f-5a33cbdd6b81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:58:41.583645 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-618eab35-6682-4b0e-860f-5a33cbdd6b81 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.401814 Sep 14 00:58:41.584190 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 28/56] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Sep 14 00:58:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 00:58:42.809956 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-f6dc754f-f5b7-436c-bb2e-11ce2108752a admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:42.810972 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-f6dc754f-f5b7-436c-bb2e-11ce2108752a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Sep 14 00:58:42.811370 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 29/57] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 00:58:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:58:43.333644 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-13f9ec36-d471-4882-bc7f-7009d8f5d6d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:58:43.352221 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-13f9ec36-d471-4882-bc7f-7009d8f5d6d0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.402336 Sep 14 00:58:43.352764 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 29/58] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Sep 14 00:58:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 00:58:44.569672 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-f6dc754f-f5b7-436c-bb2e-11ce2108752a admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:44.570685 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-f6dc754f-f5b7-436c-bb2e-11ce2108752a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Sep 14 00:58:44.571101 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 30/59] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 00:58:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:58:45.095018 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-d35a49c8-6a4d-49a8-bf2d-8ccc6d52a6ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 00:58:45.114231 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-d35a49c8-6a4d-49a8-bf2d-8ccc6d52a6ed admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.402619 Sep 14 00:58:45.114701 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 30/60] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Sep 14 00:58:44 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 00:58:46.341030 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-f6dc754f-f5b7-436c-bb2e-11ce2108752a admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:46.342031 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-f6dc754f-f5b7-436c-bb2e-11ce2108752a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 14 00:58:46.342425 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 31/61] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 00:58:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:58:46.860267 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-3e3aef29-7134-4c40-addb-cb678da48de3 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:58:46.880220 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-3e3aef29-7134-4c40-addb-cb678da48de3 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.399472 Sep 14 00:58:46.880754 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 31/62] 10.222.0.42 () {60 vars in 1202 bytes} [Wed Sep 14 00:58:46 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 00:59:43.947824 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-f6dc754f-f5b7-436c-bb2e-11ce2108752a admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:59:43.949429 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-f6dc754f-f5b7-436c-bb2e-11ce2108752a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 Sep 14 00:59:43.949829 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 32/63] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 00:59:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 00:59:43.960709 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:44.344822 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-36322b86-2086-4d4c-8599-6c2eccc8ed6b admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:59:44.370598 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-36322b86-2086-4d4c-8599-6c2eccc8ed6b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.414081 Sep 14 00:59:44.371266 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 32/64] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Sep 14 00:59:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 00:59:44.393667 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writing DB stats nova_api:SELECT=14 {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 00:59:44.397639 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-31f4177f-87d2-473c-81ba-e33b10768b82 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:59:44.405110 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-31f4177f-87d2-473c-81ba-e33b10768b82 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012872 Sep 14 00:59:44.405624 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 33/65] 10.222.0.42 () {60 vars in 1283 bytes} [Wed Sep 14 00:59:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 00:59:44.417651 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-fb8970c9-2c01-4a1c-bebc-d4d1bd53f5c9 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:59:44.424890 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-fb8970c9-2c01-4a1c-bebc-d4d1bd53f5c9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011366 Sep 14 00:59:44.425402 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 33/66] 10.222.0.42 () {60 vars in 1286 bytes} [Wed Sep 14 00:59:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 00:59:44.437417 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-0361f19d-4564-4c50-bc6c-94e64de90360 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:59:44.444500 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-0361f19d-4564-4c50-bc6c-94e64de90360 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010669 Sep 14 00:59:44.445010 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 34/67] 10.222.0.42 () {60 vars in 1286 bytes} [Wed Sep 14 00:59:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 00:59:44.456310 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-119feae2-2d5d-4314-85d5-41d263dff6b7 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 00:59:44.463447 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-119feae2-2d5d-4314-85d5-41d263dff6b7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010617 Sep 14 00:59:44.464001 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 34/68] 10.222.0.42 () {60 vars in 1283 bytes} [Wed Sep 14 00:59:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:02:40.483189 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-0361f19d-4564-4c50-bc6c-94e64de90360 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:02:40.484303 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-0361f19d-4564-4c50-bc6c-94e64de90360 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Sep 14 01:02:40.484697 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 35/69] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 01:02:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:02:40.626747 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_api:SELECT=6 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:02:40.791216 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-ab79aa77-0a50-4dd8-896a-6333751529e8 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:02:40.796167 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-ab79aa77-0a50-4dd8-896a-6333751529e8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:02:40.796647 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-ab79aa77-0a50-4dd8-896a-6333751529e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:02:40.797077 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-ab79aa77-0a50-4dd8-896a-6333751529e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:02:40.797794 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-ab79aa77-0a50-4dd8-896a-6333751529e8 admin admin] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:02:40.798243 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-ab79aa77-0a50-4dd8-896a-6333751529e8 admin admin] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:02:40.798662 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-ab79aa77-0a50-4dd8-896a-6333751529e8 admin admin] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:02:40.830692 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-ab79aa77-0a50-4dd8-896a-6333751529e8 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.205304 Sep 14 01:02:40.831245 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 35/70] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Sep 14 01:02:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 01:02:41.915196 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-0361f19d-4564-4c50-bc6c-94e64de90360 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:02:41.916261 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-0361f19d-4564-4c50-bc6c-94e64de90360 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 14 01:02:41.916659 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 36/71] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 01:02:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:02:42.116268 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-f6208d51-d26e-473e-afc6-f835511eaf08 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:02:42.119728 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-f6208d51-d26e-473e-afc6-f835511eaf08 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:02:42.120209 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-f6208d51-d26e-473e-afc6-f835511eaf08 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:02:42.120705 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-f6208d51-d26e-473e-afc6-f835511eaf08 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:02:42.121680 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-f6208d51-d26e-473e-afc6-f835511eaf08 admin admin] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:02:42.122188 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-f6208d51-d26e-473e-afc6-f835511eaf08 admin admin] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:02:42.122570 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-f6208d51-d26e-473e-afc6-f835511eaf08 admin admin] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:02:42.142782 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-f6208d51-d26e-473e-afc6-f835511eaf08 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.080133 Sep 14 01:02:42.143354 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 36/72] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Sep 14 01:02:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 01:02:53.643206 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-0361f19d-4564-4c50-bc6c-94e64de90360 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:02:53.644262 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-0361f19d-4564-4c50-bc6c-94e64de90360 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 14 01:02:53.644656 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 37/73] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 01:02:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:02:53.788983 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_cell0:SELECT=4 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:02:53.789621 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_cell1:SELECT=4 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:02:53.790230 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG dbcounter [-] [105634] Writing DB stats nova_api:SELECT=8 {{(pid=105634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:02:53.838356 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-57395fc1-c0f1-4395-a013-8f5a09cbb442 admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:02:53.842343 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-57395fc1-c0f1-4395-a013-8f5a09cbb442 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:02:53.842820 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-57395fc1-c0f1-4395-a013-8f5a09cbb442 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:02:53.843256 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-57395fc1-c0f1-4395-a013-8f5a09cbb442 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:02:53.844012 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-57395fc1-c0f1-4395-a013-8f5a09cbb442 admin admin] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:02:53.844467 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-57395fc1-c0f1-4395-a013-8f5a09cbb442 admin admin] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:02:53.844886 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-57395fc1-c0f1-4395-a013-8f5a09cbb442 admin admin] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:02:53.870068 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-57395fc1-c0f1-4395-a013-8f5a09cbb442 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.085518 Sep 14 01:02:53.870688 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 37/74] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Sep 14 01:02:53 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:02:54.962249 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG nova.api.openstack.wsgi [None req-0361f19d-4564-4c50-bc6c-94e64de90360 admin admin] Calling method '>' {{(pid=105635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:02:54.963248 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: INFO nova.api.openstack.requestlog [None req-0361f19d-4564-4c50-bc6c-94e64de90360 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Sep 14 01:02:54.963662 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: [pid: 105635|app: 0|req: 38/75] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 01:02:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:02:55.162626 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG nova.api.openstack.wsgi [None req-50956f64-015c-4b46-a4fa-c550cf1c9fea admin admin] Calling method '>' {{(pid=105634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:02:55.165981 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-50956f64-015c-4b46-a4fa-c550cf1c9fea admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:02:55.166452 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-50956f64-015c-4b46-a4fa-c550cf1c9fea admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:02:55.166880 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-50956f64-015c-4b46-a4fa-c550cf1c9fea admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:02:55.168431 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-50956f64-015c-4b46-a4fa-c550cf1c9fea admin admin] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:02:55.168883 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-50956f64-015c-4b46-a4fa-c550cf1c9fea admin admin] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:02:55.169299 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: DEBUG oslo_concurrency.lockutils [None req-50956f64-015c-4b46-a4fa-c550cf1c9fea admin admin] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:02:55.190579 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: INFO nova.api.openstack.requestlog [None req-50956f64-015c-4b46-a4fa-c550cf1c9fea admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.085398 Sep 14 01:02:55.191112 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: [pid: 105634|app: 0|req: 38/76] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Sep 14 01:02:55 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:03:54.411111 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: Wed Sep 14 01:03:54 2022 - graceful shutdown triggered... Sep 14 01:03:54.410508 dv-cinder-857528-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 14 01:03:54.412130 dv-cinder-857528-1-iscsi devstack@n-api.service[105634]: Gracefully killing worker 1 (pid: 105634)... Sep 14 01:03:54.412510 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: Gracefully killing worker 2 (pid: 105635)... Sep 14 01:03:54.541020 dv-cinder-857528-1-iscsi devstack@n-api.service[105635]: DEBUG dbcounter [-] [105635] Writing DB stats nova_api:SELECT=4 {{(pid=105635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:03:55.411613 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: worker 1 buried after 1 seconds Sep 14 01:03:55.412168 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: worker 2 buried after 1 seconds Sep 14 01:03:55.412168 dv-cinder-857528-1-iscsi devstack@n-api.service[105633]: goodbye to uWSGI. Sep 14 01:03:55.413213 dv-cinder-857528-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 14 01:03:55.413763 dv-cinder-857528-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 14 01:03:55.417233 dv-cinder-857528-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 14 01:03:55.426775 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 14 01:03:55.428798 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 14 01:03:55 2022] *** Sep 14 01:03:55.428798 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 14 01:03:55.428798 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 14 01:03:55.428798 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: nodename: dv-cinder-857528-1-iscsi Sep 14 01:03:55.428798 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: machine: x86_64 Sep 14 01:03:55.428798 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: clock source: unix Sep 14 01:03:55.428798 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: pcre jit disabled Sep 14 01:03:55.428798 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: detected number of CPU cores: 4 Sep 14 01:03:55.428798 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: current working directory: / Sep 14 01:03:55.428798 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: detected binary path: /usr/bin/uwsgi-core Sep 14 01:03:55.428798 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: your processes number limit is 47680 Sep 14 01:03:55.429527 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: your memory page size is 4096 bytes Sep 14 01:03:55.429527 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: detected max file descriptor number: 2048 Sep 14 01:03:55.429527 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: lock engine: pthread robust mutexes Sep 14 01:03:55.429527 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: thunder lock: enabled Sep 14 01:03:55.429527 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 14 01:03:55.429527 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 14 01:03:55.468743 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: Python main interpreter initialized at 0x5630ce2229c0 Sep 14 01:03:55.468743 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: python threads support enabled Sep 14 01:03:55.468743 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: your server socket listen backlog is limited to 100 connections Sep 14 01:03:55.468743 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: your mercy for graceful operations on workers is 90 seconds Sep 14 01:03:55.469187 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: mapped 403077 bytes (393 KB) for 2 cores Sep 14 01:03:55.469187 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: *** Operational MODE: preforking *** Sep 14 01:03:55.469460 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: *** uWSGI is running in multiple interpreter mode *** Sep 14 01:03:55.469460 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: spawned uWSGI master process (pid: 120609) Sep 14 01:03:55.469664 dv-cinder-857528-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 14 01:03:55.470242 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: spawned uWSGI worker 1 (pid: 120620, cores: 1) Sep 14 01:03:55.470592 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: spawned uWSGI worker 2 (pid: 120621, cores: 1) Sep 14 01:03:55.470748 dv-cinder-857528-1-iscsi devstack@n-api.service[120609]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 14 01:03:56.151345 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 14 01:03:56.154358 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 14 01:03:57.332886 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 01:03:57.332886 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: from cryptography.utils import int_from_bytes Sep 14 01:03:57.333493 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 01:03:57.333493 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: from cryptography.utils import int_from_bytes Sep 14 01:03:57.335470 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 01:03:57.335470 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: from cryptography.utils import int_from_bytes Sep 14 01:03:57.335980 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 01:03:57.335980 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: from cryptography.utils import int_from_bytes Sep 14 01:03:59.785393 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 01:03:59.785965 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 01:03:59.786244 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 01:03:59.786548 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 01:03:59.786803 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 01:03:59.787251 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.787529 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.787881 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.788206 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.788542 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.788859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.789186 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.789507 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.789840 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.790104 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.791132 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.791499 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857528-1-iscsi {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.791941 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.792179 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.792501 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.792831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.793142 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.793472 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.793786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.793891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 01:03:59.794263 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 01:03:59.794343 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.795872 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 01:03:59.796011 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.796102 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 01:03:59.796189 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.796268 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 01:03:59.796350 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.796428 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.796508 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.796611 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.796692 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.796765 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.796841 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.796920 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.797005 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.797369 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.797587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.797851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.798087 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.798305 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.798552 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.798770 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.798985 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857528-1-iscsi {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.799205 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.799517 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.799778 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.799998 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.800210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.800422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.800638 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857528-1-iscsi {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.800887 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.801102 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.801306 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.801515 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.801719 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.801923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.802143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.802326 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.802508 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.802693 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.802845 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.802998 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.803193 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.803346 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.803503 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.803678 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.803880 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.804040 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.804192 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.804334 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.804483 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.804631 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.804777 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.804937 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.805092 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.805270 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.805422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.805574 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.805716 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.805916 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.806070 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.806219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.806360 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.806360 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.806643 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.806643 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.807296 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.807296 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.807613 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857528-1-iscsi {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.807946 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.808831 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.809000 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.809152 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.809302 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.809446 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.809606 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.809606 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.809606 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.810015 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.810167 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.810321 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.810464 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.810603 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.810756 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.810898 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.811045 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.811195 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.811342 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.811484 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.811716 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.811883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.812032 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.812186 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.812336 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.812485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.812634 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.812782 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.812938 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.813083 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.813233 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.813418 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.813571 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.813713 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.813908 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.814061 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.814203 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.814351 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.814502 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.814651 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.814810 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.814959 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.815107 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.815253 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.815393 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.815539 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.815782 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.815934 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.816121 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.816273 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.816273 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.816561 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.816710 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.816859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.817016 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.817343 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.817493 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.817650 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.817804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.817987 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.818135 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.818474 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.819007 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.819162 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.819305 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.819445 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.819615 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.819771 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.819926 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.820067 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.820219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.820359 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.820506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.820656 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.820806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.820959 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.821099 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.821239 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.821385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.821602 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.821759 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.821902 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.822050 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.822203 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.822505 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.822660 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.822812 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.822955 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.823104 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.823261 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.823404 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.823589 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.823748 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.823891 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.824033 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.824173 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.824323 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.824479 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.824628 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.824777 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.824918 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.825070 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.825211 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.825360 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.825508 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.825648 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.825795 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.825945 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.825945 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.826236 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.826384 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.826524 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.826673 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.826822 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.826972 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.827120 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.827484 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.827657 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.827815 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.827965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.828105 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.828252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.828577 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.829195 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.829349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.829497 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.829638 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.829785 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.829927 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.830152 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.830297 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.830438 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.830585 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.830733 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.830883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.831044 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.831206 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.831349 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.831488 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.831662 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.831804 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.831965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.832115 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.832256 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.832411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.832559 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.832710 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.832861 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.833001 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.833140 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.833286 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.833435 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.833588 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.833737 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.833884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.834032 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.834187 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.834340 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.834489 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.834630 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.834787 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.834942 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.835102 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.835243 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.835389 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.835531 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.835736 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.835890 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.835890 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.836166 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.836307 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.836446 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.836587 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.836751 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.836899 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.837739 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.837905 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.838062 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.838261 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.838464 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.838787 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.839377 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.839528 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.839691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.839851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.840012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.840155 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.840296 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.840443 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.840584 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.840736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.840886 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.841027 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.841167 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.841308 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.841459 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.841608 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.841749 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.841900 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.841900 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.842182 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.842346 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.842496 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.842642 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.842789 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.842976 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.843133 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.843288 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.843429 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.843429 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.843752 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.843914 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.844057 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.844211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.844359 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 01:03:59.844508 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.844659 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.844800 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.844953 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.845104 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.845258 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.845423 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.846085 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.846249 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.846399 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.846556 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.846708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.846849 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.846990 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.847139 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.847287 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.847441 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.847652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.847967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.848118 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.848290 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.849350 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.849608 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.849764 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.849915 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.850081 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.850310 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.850464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.850616 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.850758 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.850899 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.851047 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.851195 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.851345 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.851508 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.851675 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.851816 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.851924 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.852081 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.852240 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.852486 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.852670 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.853413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.853653 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.853862 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.854025 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.854183 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.854332 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.854482 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.854631 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.854779 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.854930 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.855079 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.855220 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.855360 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.855507 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.855707 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.855864 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.856006 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.856157 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.856296 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.856435 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.856590 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.856738 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.856886 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.857033 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.857174 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.857321 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.857470 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.857619 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.857767 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.858103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.858272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.858573 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.858747 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.858899 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.859065 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.859586 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.859842 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.859990 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.859990 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.860350 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.860350 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.860350 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.860860 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.861023 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.861174 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.861323 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.861464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.861612 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.861762 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.861925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.862076 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.862218 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.862365 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.862514 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.862665 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.862821 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.862981 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.863123 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.863269 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.863409 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.863607 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.863773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.863987 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.864132 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.864273 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.864414 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.864564 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.864712 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.864864 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.865014 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.865155 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.865303 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.865457 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.865606 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.865757 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.865905 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.866055 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.866194 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.866343 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.866492 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.866633 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.866788 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.866936 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.867078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.867228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.867376 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.867801 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.868793 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.868950 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.869105 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.869257 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.869768 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.869919 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.870060 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.870221 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.870378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.870521 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.870662 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.870984 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.871132 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.871274 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.871424 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.871583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.871740 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.871900 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.872047 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.872187 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.872353 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.872494 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.872641 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.872782 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.872930 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.873084 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.873234 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.873383 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.873534 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.873675 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.873822 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.873974 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.874133 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.874275 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.874416 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.874564 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.874704 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.874852 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.874992 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.875132 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.875272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.875412 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.875601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.875766 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.875916 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.876076 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.876218 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.876364 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.876519 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.876661 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.876811 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.876959 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.877108 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.877255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.877404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.877546 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.877695 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.877843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.878001 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.878249 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.878469 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.878616 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.878810 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.878966 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.879108 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.879256 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.879412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.879905 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.880066 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.880209 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.880349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.880499 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.880649 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.880791 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.881117 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.881279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.881421 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.881576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.881732 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.881877 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.882025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.882166 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.882306 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.882478 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.882621 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.882763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.882902 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.883041 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.883180 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.883335 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.883479 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.883653 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.883809 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.883990 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.884263 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.884425 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.884580 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.884721 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.884864 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.885004 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.885158 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.885300 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.885440 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.885588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.885739 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.885889 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.886044 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.886193 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.886415 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.886590 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.886741 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.886884 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.887039 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.887199 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.887480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.887660 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.887818 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.887969 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.888119 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.888353 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.888594 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.888743 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.888937 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.889097 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.889240 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.889387 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.889528 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.890278 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.890440 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.890597 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.890747 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.890896 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.891037 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.891361 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.891518 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.891801 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.891947 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.892097 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.892248 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.892399 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.892540 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.892690 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.892831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.892972 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.893111 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.893260 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.893409 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.893570 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.893759 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.893913 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.894062 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.894211 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.894366 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.894366 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.894643 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.894790 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.894938 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.895086 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.895235 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.895378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.895535 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.895735 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.895876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.896015 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.896167 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.896308 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.896456 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.896598 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.896745 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.896894 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.897048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.897196 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.897337 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.897490 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.897630 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.897783 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.897925 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.898073 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.898073 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.898073 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.898073 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.898073 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.898073 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.898073 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.898073 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.899377 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.900070 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.900637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.900797 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.900949 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.901098 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.901240 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.901559 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.901720 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.901864 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.902018 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.902164 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.902312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.902467 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.902626 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.902626 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.902905 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.903055 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.903196 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.903349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.903499 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.903680 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.903834 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.904579 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.904736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.904736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.905045 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.905202 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.905351 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.905507 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.905894 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.906065 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.906285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.906622 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.906790 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.906943 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.907117 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.907287 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.907436 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.907662 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.907837 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.908106 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.908285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.908444 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.908613 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.908930 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.909132 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.909295 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.909455 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.909613 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.909775 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.909923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.910071 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.910218 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.910392 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.910923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.911090 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.911248 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.911405 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.911801 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.911975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.912128 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.912275 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.912445 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.912595 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.912758 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.912916 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.912916 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.913207 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.913356 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.913550 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.913713 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.913874 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.914065 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.914215 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.914372 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.914531 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.914689 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.914844 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.914992 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.915169 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.915893 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.916057 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.916243 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.916404 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.916733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.916902 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.917059 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.917229 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.917617 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.917778 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.917928 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.918116 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.918270 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.918467 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.918626 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.918626 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.919772 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.919772 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.919937 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.920024 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.920098 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.920176 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.920248 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.920248 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.920386 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.920467 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.920549 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.920622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.920705 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.920785 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.920858 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.920928 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.921005 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.921082 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.921162 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.921234 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.921311 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.921391 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.921471 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.921552 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.921624 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.921694 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.921763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.921842 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.921913 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.921996 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.922078 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.922157 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.922236 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.922313 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.922391 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.922523 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.922605 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.922678 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.922754 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.922833 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.922905 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.922987 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.923060 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.923131 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.923201 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.923279 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.923359 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.923439 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.923511 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.923600 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.923686 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.923759 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.923842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.923925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.924003 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.924075 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.924152 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.924223 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.924316 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.924316 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.924464 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.924464 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.924610 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.924695 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.924778 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.924851 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.924922 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.924999 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.925072 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.925155 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.925228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.925298 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.925375 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.925447 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.925517 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.925595 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.925673 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.925745 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.925817 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.925893 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.925973 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.926111 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.926186 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.926256 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.926333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.926411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.926488 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.926568 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.926641 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.926718 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.926796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.926867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.926949 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.927028 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.927100 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.927177 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.927256 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.927328 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.927406 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.927485 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.927590 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.927668 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.927750 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.927823 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.927902 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.927975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.928052 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.928131 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.928209 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.928287 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.928371 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.928444 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.928522 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.928600 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.928672 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.928672 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.928810 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.928810 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.928937 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.928937 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.929072 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.929153 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.929225 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.929297 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.929367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.929438 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.929516 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.929596 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.929686 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.929764 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.929841 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.929912 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.929982 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.930059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.930131 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.930207 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.930284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.930355 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.930431 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.930510 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.930581 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.930656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.930735 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.930843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.931020 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.931162 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.931307 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.931464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.931588 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.931666 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.931753 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.931835 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.931907 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.931978 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.932049 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.932127 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.932207 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.932285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.932364 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.932443 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.932528 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.932600 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.932678 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.932750 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.932820 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.932889 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.932958 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.933037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.933109 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.933179 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.933408 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.933501 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.933725 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.933822 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.934087 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.934188 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.934352 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.934433 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.934662 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.934835 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.934976 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.935079 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.935283 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.935375 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.935618 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.935735 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.935922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.936023 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.936257 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.936357 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.936578 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.936672 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.936892 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.936988 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.937210 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.937303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.937523 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.937622 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.937839 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.937937 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.938148 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.938238 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.938514 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.938778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.938870 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.939142 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.939461 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.939836 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.940149 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.940460 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.940615 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.940788 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.940938 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.941093 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.941237 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.941406 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.941563 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.941734 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.941890 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.942047 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.942190 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.942377 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.942536 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.942685 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.942834 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.942986 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.943497 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.943828 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.944097 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.944508 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.944642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.944769 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.944880 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.945044 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.945164 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.945491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.945639 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.945734 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.945985 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.946087 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.946325 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.946491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.946686 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.946797 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.947002 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.947113 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.947313 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.947424 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.947667 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.947784 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.947984 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.948083 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.948296 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.948389 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.948611 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.948703 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.948921 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.949021 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.949238 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.949417 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.949549 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.949745 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.949996 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.950102 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.950313 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.950465 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.950631 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.950793 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.950941 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.951118 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.951257 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.951454 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.951620 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.951816 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.951908 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.952153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.952246 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.952469 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.952569 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.952797 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.952933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.953122 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.953297 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.953444 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.953666 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.953832 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.953972 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.954162 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.954313 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.954466 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.954613 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.954759 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.954906 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.955044 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.955209 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.955357 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.955498 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.955669 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.955822 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.955990 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.956130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.956318 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.956410 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.956628 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.956729 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.956954 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.957047 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.957355 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.957454 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.957683 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.957788 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.957994 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.958096 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.958308 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.958436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.958631 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.958734 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.958947 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.959263 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.959616 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.959710 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.959933 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.960050 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.960253 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.960385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.960572 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.960720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.960890 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.961035 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.961201 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.961357 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.961513 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.961675 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.961843 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.962026 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.962698 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.962900 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.963076 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.963260 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.963527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.963823 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.963929 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.964067 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.964193 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.964324 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.964498 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.964592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.964817 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.964909 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.965146 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.965257 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.965464 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.965578 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.965778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.965913 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.966094 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.966243 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.966446 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.966549 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.966761 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.966861 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.967091 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.967193 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.967432 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.967524 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.967789 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.967890 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.968104 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.968198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.968417 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.968516 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.968748 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.968881 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.969059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.969161 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.969376 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.969468 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.969692 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.969795 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.970007 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.970101 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.970318 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.970412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.970628 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.970728 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.970947 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.971047 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.971255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.971352 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.971579 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.971686 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.971902 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.972003 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.972220 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.972320 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.972533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.972635 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.972843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.972935 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.973155 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.973246 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.973474 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.973635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.973857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.973995 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.974088 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.974162 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.974392 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.974487 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.974714 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.974812 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.975026 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.975127 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.975337 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.975431 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.975706 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.975802 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.976023 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.976114 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.976345 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.976437 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.976663 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.976761 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.976996 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.977089 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.977319 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.977411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.977658 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.978661 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.978843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.978972 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.979060 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.979295 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.979396 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.979644 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.979741 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.979972 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.980073 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.980291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.980384 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.980615 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.980706 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.980930 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.981030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.981243 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.981338 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.981562 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.981814 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.981920 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.982153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.982245 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.982465 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.982555 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.982783 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.982876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.983095 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.983190 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.983419 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.983517 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.983758 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.983851 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.984077 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.984169 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.984372 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.984519 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.984667 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.984757 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.984990 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.985082 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.985321 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.985421 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.985647 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.985746 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.985961 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.986053 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.986291 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.986428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.986636 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.986739 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.986930 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.987021 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.987246 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.987346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.987588 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.987694 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.987952 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.988044 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.988277 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.988370 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.988590 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.988688 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.988904 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.988995 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.989224 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.989316 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.989542 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.989639 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.989859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.989949 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.990175 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.990419 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.990518 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.990757 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.990851 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.991082 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.991187 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.991401 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.991494 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.991744 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.991850 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.992064 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.992164 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.992384 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.992476 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.992705 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.992804 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.993022 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.993122 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.993390 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.993517 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.993673 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.993828 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.994012 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.994171 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.994343 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.994626 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.994768 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.994950 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.995053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.995292 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.995392 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.995632 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.995728 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.995955 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.996051 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.996275 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.996367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.996597 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.996688 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.996931 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.997032 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.997244 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.997345 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.997555 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.997659 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.997872 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.997967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.998185 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.998275 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.998498 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.998598 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.998810 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.998908 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.999130 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.999229 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.999440 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.999542 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.999854 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:03:59.999948 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.000172 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.000265 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.000486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.000719 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.000812 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.001079 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.001178 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.001403 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.001504 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.001738 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.001830 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.002067 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.002203 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.002387 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.002490 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.002701 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.003038 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.003185 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.003351 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.003687 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.003781 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.004010 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.004101 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.004329 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.004447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.004682 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.004794 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.004947 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.005041 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.005265 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.005356 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.005581 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.005675 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.005892 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.005984 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.006208 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.006300 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.006521 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.006667 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.006853 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.006945 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.007167 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.007272 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.007482 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.007597 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.007833 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.007937 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.008149 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.008253 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.008460 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.008552 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.008767 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.008857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.009108 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.009297 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.009451 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.009638 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.009835 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.009990 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.010154 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.010311 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.010565 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.010666 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.010880 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.010973 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.011199 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.011292 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.011583 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.011678 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.011897 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.012031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.012206 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.012334 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.012517 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.012620 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.012830 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.012929 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.013143 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.013235 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.013452 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.013587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.013761 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.013886 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.014074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.014194 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.014386 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.014511 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.014695 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.015163 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.015282 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.015393 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.015580 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.015713 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.015918 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.016168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.016296 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.016514 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.016633 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.016834 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.016952 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.017151 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.017278 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.017462 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.017580 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.017771 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.017889 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.018079 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.018199 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.018387 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.018507 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.018701 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.018828 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.019008 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.019135 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.019330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.019456 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.019669 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.019806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.019981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.020102 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.020299 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.020426 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.020617 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.020746 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.020935 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.021063 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.021253 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.021372 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.021569 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.021689 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.021883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.021999 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.022197 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.022322 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.022509 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.022627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.022827 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.022946 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.023137 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.023256 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.023452 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.023592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.023826 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.023944 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.024145 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.024273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.024464 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.025277 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.025474 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.025671 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.025893 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.026102 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.026329 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.026563 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.026792 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.026938 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.026938 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.027208 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.027338 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.027467 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.027626 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.027757 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.027891 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.028031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.028167 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.028297 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.028475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.028609 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.028877 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.029016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.029196 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.029335 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.029513 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.029645 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.029831 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.029964 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.030147 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.030247 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.030460 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.030552 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.030777 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.030879 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.031092 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.031185 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.031408 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.031511 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.031815 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.031916 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.032129 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.032229 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.032443 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.032550 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.032768 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.032868 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.033119 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.033212 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.033436 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.033536 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.033749 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.033856 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.034061 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.034153 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.034377 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.034521 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.034693 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.034833 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.035008 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.035102 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.035327 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.035473 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.035652 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.035758 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.035969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.036069 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.036280 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.036423 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.036589 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.036682 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.036900 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.036992 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.037210 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.037354 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.037524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.037619 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.037832 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.037934 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.038142 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.038258 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.038451 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.038594 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.038758 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.038891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.039066 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.039221 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.039375 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.039540 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.039711 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.039886 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.040022 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.040294 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.040475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.040687 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.040845 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.040992 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.041146 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.041301 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.041396 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.041639 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.041746 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.041979 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.042080 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.042297 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.042396 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.042608 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.042710 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.042923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.043023 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.043245 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.043345 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.043575 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.043687 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.043891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.043989 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.044201 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.044302 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.044515 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.044608 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.044823 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.044915 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.045130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.045222 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.045439 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.045577 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.045746 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.045840 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.046065 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.046157 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.046371 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.046506 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.046678 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.046777 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.046985 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.047085 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.047290 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.047392 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.047616 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.047711 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.047922 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.048033 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.048233 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.048332 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.048540 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.048640 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.048847 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.048951 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.049153 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.049245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.049460 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.049567 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.049765 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.049869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.050098 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.050198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.050413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.050512 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.050727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.050820 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.051043 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.051136 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.051355 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.051456 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.051697 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.051803 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.052009 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.052099 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.052324 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.052423 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.052646 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.052739 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.052961 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.053052 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.053275 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.053366 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.053611 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.053711 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.053925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.054017 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.054236 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.054336 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.054552 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.054643 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.054866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.054959 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.055179 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.055280 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.055492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.055613 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.055888 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.056054 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.056211 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.056387 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.056564 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.056680 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.056821 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.056921 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.057069 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 01:04:00.057206 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.057450 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.057770 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.058083 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.058417 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.058730 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.059070 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.059384 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.059720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.060035 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.060352 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.060663 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.060976 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.061294 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.061611 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.061943 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.062272 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.062588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.062919 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.063248 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.063614 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.063934 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.064283 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.064616 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.064934 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.065250 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.065559 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 01:04:00.065804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 01:04:00.118969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO dbcounter [None req-7ed2bda9-3f42-4109-85aa-2651805c6047 None None] Registered counter for database nova_api Sep 14 01:04:00.129218 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO dbcounter [None req-4d71beb9-d880-4537-a100-a2d8e5fbb1dd None None] Registered counter for database nova_api Sep 14 01:04:00.140170 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_db.sqlalchemy.engines [None req-7ed2bda9-3f42-4109-85aa-2651805c6047 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 01:04:00.147014 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writer thread running {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 01:04:00.150126 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_db.sqlalchemy.engines [None req-4d71beb9-d880-4537-a100-a2d8e5fbb1dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120620) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 01:04:00.158086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writer thread running {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 01:04:00.204828 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.context [None req-7ed2bda9-3f42-4109-85aa-2651805c6047 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),74d3b739-38e2-4172-876a-396cfbc13f8f(cell1) {{(pid=120621) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 01:04:00.208921 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7ed2bda9-3f42-4109-85aa-2651805c6047 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:04:00.209404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7ed2bda9-3f42-4109-85aa-2651805c6047 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:04:00.211004 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7ed2bda9-3f42-4109-85aa-2651805c6047 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:04:00.211764 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7ed2bda9-3f42-4109-85aa-2651805c6047 None None] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:04:00.212810 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7ed2bda9-3f42-4109-85aa-2651805c6047 None None] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:04:00.214737 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.context [None req-4d71beb9-d880-4537-a100-a2d8e5fbb1dd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),74d3b739-38e2-4172-876a-396cfbc13f8f(cell1) {{(pid=120620) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 01:04:00.214943 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7ed2bda9-3f42-4109-85aa-2651805c6047 None None] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:04:00.216844 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO dbcounter [None req-7ed2bda9-3f42-4109-85aa-2651805c6047 None None] Registered counter for database nova_cell0 Sep 14 01:04:00.218757 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d71beb9-d880-4537-a100-a2d8e5fbb1dd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:04:00.219234 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d71beb9-d880-4537-a100-a2d8e5fbb1dd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:04:00.220871 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d71beb9-d880-4537-a100-a2d8e5fbb1dd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:04:00.221009 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO dbcounter [None req-7ed2bda9-3f42-4109-85aa-2651805c6047 None None] Registered counter for database nova_cell1 Sep 14 01:04:00.221609 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d71beb9-d880-4537-a100-a2d8e5fbb1dd None None] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:04:00.222059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d71beb9-d880-4537-a100-a2d8e5fbb1dd None None] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:04:00.224095 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d71beb9-d880-4537-a100-a2d8e5fbb1dd None None] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:04:00.226122 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO dbcounter [None req-4d71beb9-d880-4537-a100-a2d8e5fbb1dd None None] Registered counter for database nova_cell0 Sep 14 01:04:00.228265 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_db.sqlalchemy.engines [None req-7ed2bda9-3f42-4109-85aa-2651805c6047 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 01:04:00.230454 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO dbcounter [None req-4d71beb9-d880-4537-a100-a2d8e5fbb1dd None None] Registered counter for database nova_cell1 Sep 14 01:04:00.231392 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_db.sqlalchemy.engines [None req-7ed2bda9-3f42-4109-85aa-2651805c6047 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 01:04:00.236970 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writer thread running {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 01:04:00.237737 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_db.sqlalchemy.engines [None req-4d71beb9-d880-4537-a100-a2d8e5fbb1dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120620) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 01:04:00.239397 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_db.sqlalchemy.engines [None req-4d71beb9-d880-4537-a100-a2d8e5fbb1dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120620) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 01:04:00.246606 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writer thread running {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 01:04:00.246950 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writer thread running {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 01:04:00.378097 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writer thread running {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 01:04:00.388154 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO dbcounter [None req-7ed2bda9-3f42-4109-85aa-2651805c6047 None None] Registered counter for database nova_cell0 Sep 14 01:04:00.395534 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_db.sqlalchemy.engines [None req-7ed2bda9-3f42-4109-85aa-2651805c6047 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 01:04:00.398225 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO dbcounter [None req-4d71beb9-d880-4537-a100-a2d8e5fbb1dd None None] Registered counter for database nova_cell0 Sep 14 01:04:00.400777 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writer thread running {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 01:04:00.407612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_db.sqlalchemy.engines [None req-4d71beb9-d880-4537-a100-a2d8e5fbb1dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120620) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 01:04:00.412157 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writer thread running {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 01:04:00.731568 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: WARNING keystonemiddleware.auth_token [None req-7ed2bda9-3f42-4109-85aa-2651805c6047 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 01:04:00.736720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: WARNING keystonemiddleware.auth_token [None req-4d71beb9-d880-4537-a100-a2d8e5fbb1dd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 01:04:00.740532 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: WARNING keystonemiddleware.auth_token [None req-7ed2bda9-3f42-4109-85aa-2651805c6047 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 01:04:00.744690 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: WARNING keystonemiddleware.auth_token [None req-4d71beb9-d880-4537-a100-a2d8e5fbb1dd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 01:04:01.095601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: WARNING keystonemiddleware.auth_token [None req-7ed2bda9-3f42-4109-85aa-2651805c6047 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 01:04:01.097062 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: WARNING keystonemiddleware.auth_token [None req-4d71beb9-d880-4537-a100-a2d8e5fbb1dd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 01:04:01.101585 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: WARNING keystonemiddleware.auth_token [None req-7ed2bda9-3f42-4109-85aa-2651805c6047 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 01:04:01.103233 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: WARNING keystonemiddleware.auth_token [None req-4d71beb9-d880-4537-a100-a2d8e5fbb1dd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 01:04:01.107112 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5630ce2229c0 pid: 120621 (default app) Sep 14 01:04:01.108541 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5630ce2229c0 pid: 120620 (default app) Sep 14 01:04:37.940257 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=3 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:37.942018 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=3 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:37.943766 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=3 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:37.945009 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=3 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:38.067036 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=3 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:38.068074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=3 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:38.068858 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=3 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:38.069580 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=3 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:04:38.965786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-280cae15-b7c5-40cb-bed9-6923e8681aa7 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Action: 'create', calling method: .version_select at 0x7f5048da34c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-641199497"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:04:39.058702 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ef071c0d-9c79-40bb-958b-af6d256c8106 tempest-VolumesGetTestJSON-307622800 tempest-VolumesGetTestJSON-307622800-project] Action: 'create', calling method: .version_select at 0x7f5048da1430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-344630195", "metadata": {"Type": "work"}}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:04:40.323257 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-280cae15-b7c5-40cb-bed9-6923e8681aa7 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.399960 Sep 14 01:04:40.327216 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Sep 14 01:04:37 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2407 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 14 01:04:40.343206 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d4279a3f-0ab4-4e9f-9fc4-9d681cf7dd3e tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Calling method '.version_select at 0x7f5048c733a0>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:40.483121 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ef071c0d-9c79-40bb-958b-af6d256c8106 tempest-VolumesGetTestJSON-307622800 tempest-VolumesGetTestJSON-307622800-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.418612 Sep 14 01:04:40.484303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 1/2] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Sep 14 01:04:38 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2424 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 14 01:04:40.501564 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-c8450bf7-5efc-4ae9-8d69-c95307bddf97 tempest-VolumesGetTestJSON-307622800 tempest-VolumesGetTestJSON-307622800-project] Calling method '.version_select at 0x7f5048c75310>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:40.515531 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d4279a3f-0ab4-4e9f-9fc4-9d681cf7dd3e tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/717e1e38-fe39-4bd3-a250-ea76db78b9c5" status: 200 len: 344 microversion: 2.1 time: 0.176761 Sep 14 01:04:40.516728 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 01:04:40 2022] GET /compute/v2.1/os-volumes/717e1e38-fe39-4bd3-a250-ea76db78b9c5 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:04:40.610041 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-c8450bf7-5efc-4ae9-8d69-c95307bddf97 tempest-VolumesGetTestJSON-307622800 tempest-VolumesGetTestJSON-307622800-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e6657f87-00a2-4110-9045-0db433a6dbee" status: 200 len: 352 microversion: 2.1 time: 0.113570 Sep 14 01:04:40.612879 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 01:04:40 2022] GET /compute/v2.1/os-volumes/e6657f87-00a2-4110-9045-0db433a6dbee => generated 352 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:04:41.531217 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-85cb10a2-21f1-47d9-b32e-a438c33fda33 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Calling method '.version_select at 0x7f5048c73a60>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:41.624444 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d9ae2b88-c07e-4241-b290-3e6b95c549e0 tempest-VolumesGetTestJSON-307622800 tempest-VolumesGetTestJSON-307622800-project] Calling method '.version_select at 0x7f5048c759d0>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:41.627651 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-85cb10a2-21f1-47d9-b32e-a438c33fda33 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/717e1e38-fe39-4bd3-a250-ea76db78b9c5" status: 200 len: 344 microversion: 2.1 time: 0.100845 Sep 14 01:04:41.628543 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 01:04:41 2022] GET /compute/v2.1/os-volumes/717e1e38-fe39-4bd3-a250-ea76db78b9c5 => generated 344 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:04:41.714995 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d9ae2b88-c07e-4241-b290-3e6b95c549e0 tempest-VolumesGetTestJSON-307622800 tempest-VolumesGetTestJSON-307622800-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e6657f87-00a2-4110-9045-0db433a6dbee" status: 200 len: 352 microversion: 2.1 time: 0.094436 Sep 14 01:04:41.716168 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 3/6] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 01:04:41 2022] GET /compute/v2.1/os-volumes/e6657f87-00a2-4110-9045-0db433a6dbee => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:04:42.642495 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d467c6d6-3e19-496a-927e-84c9c5be1f73 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Calling method '.version_select at 0x7f5048c0e160>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:42.712074 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d467c6d6-3e19-496a-927e-84c9c5be1f73 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/717e1e38-fe39-4bd3-a250-ea76db78b9c5" status: 200 len: 345 microversion: 2.1 time: 0.073443 Sep 14 01:04:42.713195 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 01:04:42 2022] GET /compute/v2.1/os-volumes/717e1e38-fe39-4bd3-a250-ea76db78b9c5 => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:04:42.729250 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0df9a142-4558-4453-a787-cd8168a774f4 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Action: 'create', calling method: .version_select at 0x7f5048c0c040>, body: {"snapshot": {"volume_id": "717e1e38-fe39-4bd3-a250-ea76db78b9c5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-175882216"}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:04:42.733410 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-282e8f64-4143-4287-af0f-e0e7f796d692 tempest-VolumesGetTestJSON-307622800 tempest-VolumesGetTestJSON-307622800-project] Calling method '.version_select at 0x7f5048c73d30>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:42.816780 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-282e8f64-4143-4287-af0f-e0e7f796d692 tempest-VolumesGetTestJSON-307622800 tempest-VolumesGetTestJSON-307622800-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e6657f87-00a2-4110-9045-0db433a6dbee" status: 200 len: 353 microversion: 2.1 time: 0.090857 Sep 14 01:04:42.831858 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 5/8] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 01:04:42 2022] GET /compute/v2.1/os-volumes/e6657f87-00a2-4110-9045-0db433a6dbee => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:04:42.843227 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b2ec449f-df84-49a8-ac1e-0c8f1329ec24 tempest-VolumesGetTestJSON-307622800 tempest-VolumesGetTestJSON-307622800-project] Calling method '.version_select at 0x7f5048c734c0>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:42.978561 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b2ec449f-df84-49a8-ac1e-0c8f1329ec24 tempest-VolumesGetTestJSON-307622800 tempest-VolumesGetTestJSON-307622800-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e6657f87-00a2-4110-9045-0db433a6dbee" status: 200 len: 353 microversion: 2.1 time: 0.145223 Sep 14 01:04:42.993635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 6/9] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 01:04:42 2022] GET /compute/v2.1/os-volumes/e6657f87-00a2-4110-9045-0db433a6dbee => generated 353 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:04:42.999496 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6d2f2024-a495-4d90-81e9-311958812d2e tempest-VolumesGetTestJSON-307622800 tempest-VolumesGetTestJSON-307622800-project] Calling method '.version_select at 0x7f5048c0e3a0>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:43.148930 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6d2f2024-a495-4d90-81e9-311958812d2e tempest-VolumesGetTestJSON-307622800 tempest-VolumesGetTestJSON-307622800-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/e6657f87-00a2-4110-9045-0db433a6dbee" status: 202 len: 0 microversion: 2.1 time: 0.152653 Sep 14 01:04:43.153719 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 7/10] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Sep 14 01:04:42 2022] DELETE /compute/v2.1/os-volumes/e6657f87-00a2-4110-9045-0db433a6dbee => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:04:43.159851 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4586aa0b-8409-4c80-a5e0-a502cc252201 tempest-VolumesGetTestJSON-307622800 tempest-VolumesGetTestJSON-307622800-project] Calling method '.version_select at 0x7f5048c73430>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:43.426533 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0df9a142-4558-4453-a787-cd8168a774f4 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.703156 Sep 14 01:04:43.442633 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 4/11] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Sep 14 01:04:42 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:04:43.468835 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-60644105-ef4e-4094-92af-20659b27ee29 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Calling method '.version_select at 0x7f5048c0ca60>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:43.531276 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4586aa0b-8409-4c80-a5e0-a502cc252201 tempest-VolumesGetTestJSON-307622800 tempest-VolumesGetTestJSON-307622800-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e6657f87-00a2-4110-9045-0db433a6dbee" status: 200 len: 352 microversion: 2.1 time: 0.376367 Sep 14 01:04:43.532120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 8/12] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 01:04:43 2022] GET /compute/v2.1/os-volumes/e6657f87-00a2-4110-9045-0db433a6dbee => generated 352 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:04:43.589624 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-60644105-ef4e-4094-92af-20659b27ee29 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a" status: 200 len: 286 microversion: 2.1 time: 0.141392 Sep 14 01:04:43.593245 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 5/13] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Sep 14 01:04:43 2022] GET /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a => generated 286 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:04:43.605703 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e778b925-1355-456e-b5c1-8af1a97496b3 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Calling method '.version_select at 0x7f5048c73af0>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:43.792677 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e778b925-1355-456e-b5c1-8af1a97496b3 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.191561 Sep 14 01:04:43.793236 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 9/14] 10.222.0.42 () {58 vars in 1140 bytes} [Wed Sep 14 01:04:43 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:04:43.806578 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7709e549-e00a-466a-8f84-e466d8132395 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Calling method '.version_select at 0x7f5048c0c1f0>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:43.859683 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7709e549-e00a-466a-8f84-e466d8132395 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a" status: 200 len: 286 microversion: 2.1 time: 0.058580 Sep 14 01:04:43.860641 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 6/15] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Sep 14 01:04:43 2022] GET /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:04:44.545987 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-47e00419-c0dc-4a03-aeaf-9270f68e02cb tempest-VolumesGetTestJSON-307622800 tempest-VolumesGetTestJSON-307622800-project] Calling method '.version_select at 0x7f5048c0ed30>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:44.595293 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-47e00419-c0dc-4a03-aeaf-9270f68e02cb tempest-VolumesGetTestJSON-307622800 tempest-VolumesGetTestJSON-307622800-project] HTTP exception thrown: Volume e6657f87-00a2-4110-9045-0db433a6dbee could not be found. Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-47e00419-c0dc-4a03-aeaf-9270f68e02cb tempest-VolumesGetTestJSON-307622800 tempest-VolumesGetTestJSON-307622800-project] Request method failure captured: Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/os-volumes/e6657f87-00a2-4110-9045-0db433a6dbee HTTP/1.1 Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISil2eQIBtN4FECdX4oNLAPLx-U04RGV8nnjYc2zMGRKEvIqJQkPOl9pwWawlRpTTzTEWIsv2pL_PEWdXman1gmLEVnxPZs0-dG3F3FXj7KD6ZXu9j_SV4eJ9IzWfRn7uGt73Mrc4PiV-Ju_tADz0dkwCZk1CPn1-ZNFHNiWSp8Ll30 Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 437899e27b144fcea3b6c06acc7df525 Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-VolumesGetTestJSON-307622800 Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:04:44.601813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:04:44.602983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/437899e27b144fcea3b6c06acc7df525"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/437899e27b144fcea3b6c06acc7df525"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/437899e27b144fcea3b6c06acc7df525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_437899e27b144fcea3b6c06acc7df525"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:04:44.602983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-VolumesGetTestJSON-307622800 Sep 14 01:04:44.602983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 437899e27b144fcea3b6c06acc7df525 Sep 14 01:04:44.602983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-VolumesGetTestJSON-307622800 Sep 14 01:04:44.602983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-VolumesGetTestJSON-307622800-project Sep 14 01:04:44.602983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:04:44.602983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:04:44.602983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: 0ded01b9a7c44e89a6ec9d0f8d0bd1a1 Sep 14 01:04:44.602983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-VolumesGetTestJSON-307622800-project Sep 14 01:04:44.602983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: Sep 14 01:04:44.602983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Volume e6657f87-00a2-4110-9045-0db433a6dbee could not be found. Sep 14 01:04:44.602983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': 'e6657f87-00a2-4110-9045-0db433a6dbee'} Sep 14 01:04:44.602983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:04:44.603691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:04:44.603691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 01:04:44.603691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 01:04:44.603691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 01:04:44.603691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 01:04:44.603691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 01:04:44.603691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 01:04:44.603691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 01:04:44.603691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 01:04:44.603691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 01:04:44.603691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 01:04:44.603691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 01:04:44.603691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 01:04:44.603691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 01:04:44.603691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 01:04:44.603691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e6657f87-00a2-4110-9045-0db433a6dbee could not be found. (HTTP 404) (Request-ID: req-eb502554-b591-4b8d-8216-a82c5cfde514) Sep 14 01:04:44.603691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:44.603691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:04:44.603691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:44.604637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:04:44.604637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 14 01:04:44.604637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 14 01:04:44.604637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 01:04:44.604637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 01:04:44.604637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 01:04:44.604637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 01:04:44.604637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 01:04:44.604637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 01:04:44.604637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 01:04:44.604637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 01:04:44.604637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 01:04:44.604637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 01:04:44.604637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 01:04:44.604637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 01:04:44.604637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 01:04:44.604637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 01:04:44.604637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 01:04:44.604637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 01:04:44.605619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 01:04:44.605619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 01:04:44.605619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 01:04:44.605619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 01:04:44.605619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e6657f87-00a2-4110-9045-0db433a6dbee could not be found. Sep 14 01:04:44.605619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:44.605619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:04:44.605619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:44.605619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:04:44.605619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:04:44.605619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:04:44.605619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:04:44.605619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:04:44.605619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 01:04:44.605619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 01:04:44.605619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:04:44.605619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:04:44.605619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 14 01:04:44.605619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:04:44.606518 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e6657f87-00a2-4110-9045-0db433a6dbee could not be found. Sep 14 01:04:44.606518 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:44.606518 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:04:44.606518 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:44.606518 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:04:44.606518 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:04:44.606518 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:04:44.606518 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:04:44.606518 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:04:44.606518 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e6657f87-00a2-4110-9045-0db433a6dbee could not be found. Sep 14 01:04:44.606518 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:44.609033 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-47e00419-c0dc-4a03-aeaf-9270f68e02cb tempest-VolumesGetTestJSON-307622800 tempest-VolumesGetTestJSON-307622800-project] Returning 404 to user: Volume e6657f87-00a2-4110-9045-0db433a6dbee could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:04:44.610090 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-47e00419-c0dc-4a03-aeaf-9270f68e02cb tempest-VolumesGetTestJSON-307622800 tempest-VolumesGetTestJSON-307622800-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e6657f87-00a2-4110-9045-0db433a6dbee" status: 404 len: 109 microversion: 2.1 time: 0.068003 Sep 14 01:04:44.613030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 10/16] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 01:04:44 2022] GET /compute/v2.1/os-volumes/e6657f87-00a2-4110-9045-0db433a6dbee => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:04:44.875872 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-392a93bb-2e3d-4bd7-a4aa-800cdb163325 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Calling method '.version_select at 0x7f5048c75e50>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:44.959817 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-392a93bb-2e3d-4bd7-a4aa-800cdb163325 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a" status: 200 len: 286 microversion: 2.1 time: 0.091678 Sep 14 01:04:44.962996 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 7/17] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Sep 14 01:04:44 2022] GET /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:04:45.975183 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3576b30f-1155-4f98-826d-2f5aa53ebfab tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Calling method '.version_select at 0x7f5048c73670>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:46.167504 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3576b30f-1155-4f98-826d-2f5aa53ebfab tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a" status: 200 len: 286 microversion: 2.1 time: 0.196220 Sep 14 01:04:46.168101 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 11/18] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Sep 14 01:04:45 2022] GET /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a => generated 286 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:04:47.180796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-88de2f75-8c74-4f49-bd57-9262363b25a7 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Calling method '.version_select at 0x7f5048c75790>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:47.251963 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-88de2f75-8c74-4f49-bd57-9262363b25a7 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a" status: 200 len: 286 microversion: 2.1 time: 0.075704 Sep 14 01:04:47.253193 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 8/19] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Sep 14 01:04:47 2022] GET /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:04:48.266161 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-74e56017-2730-4509-a9ad-fea3620677ef tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Calling method '.version_select at 0x7f5048c73160>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:48.340920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-74e56017-2730-4509-a9ad-fea3620677ef tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a" status: 200 len: 286 microversion: 2.1 time: 0.078968 Sep 14 01:04:48.346150 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 12/20] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Sep 14 01:04:48 2022] GET /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:04:49.356798 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-bad8c0e9-3961-4951-ae45-4cb7f3e7e451 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Calling method '.version_select at 0x7f5048c0cca0>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:49.436213 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-bad8c0e9-3961-4951-ae45-4cb7f3e7e451 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a" status: 200 len: 286 microversion: 2.1 time: 0.086024 Sep 14 01:04:49.436778 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 9/21] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Sep 14 01:04:49 2022] GET /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:04:50.450203 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f7759c0b-3fdc-47d6-9916-ca808b8af190 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Calling method '.version_select at 0x7f5048c73790>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:50.855199 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f7759c0b-3fdc-47d6-9916-ca808b8af190 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a" status: 200 len: 287 microversion: 2.1 time: 0.409984 Sep 14 01:04:50.856006 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 13/22] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Sep 14 01:04:50 2022] GET /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a => generated 287 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:04:50.878409 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-bc524593-0fb0-4204-89e1-45013d4fd058 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Calling method '.version_select at 0x7f5048c0c8b0>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:51.033186 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-bc524593-0fb0-4204-89e1-45013d4fd058 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a" status: 202 len: 0 microversion: 2.1 time: 0.166763 Sep 14 01:04:51.034152 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 10/23] 10.222.0.42 () {58 vars in 1254 bytes} [Wed Sep 14 01:04:50 2022] DELETE /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 01:04:51.043426 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f9418d64-f4f4-4f0e-a99a-80a40618367d tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Calling method '.version_select at 0x7f5048bf8430>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:51.565485 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-f9418d64-f4f4-4f0e-a99a-80a40618367d tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] HTTP exception thrown: Snapshot ec3f0c94-f647-4c65-aaad-83394848661a could not be found. Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f9418d64-f4f4-4f0e-a99a-80a40618367d tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Request method failure captured: Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a HTTP/1.1 Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISilQOcWZqpuqZjGrGxQqkG4S2YVMgZhc8WOU6CdetEgQj7ITxdJF8uq3JCOVuE1D1ZJ1YeZQAn6Lb8ud2rsyLJS4G8WaIxXooZ0l1ns5ZGUpIOdnruWBVhYGzE3m1tm9pV1W8xI-xnAYRSFuAwwAE8ghb-_HUTUdn9kMXHZCju1rG4 Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 9a61a5cdab00450abcb069278b29edf3 Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1659171151 Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:04:51.569120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:04:51.570629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9a61a5cdab00450abcb069278b29edf3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9a61a5cdab00450abcb069278b29edf3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9a61a5cdab00450abcb069278b29edf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9a61a5cdab00450abcb069278b29edf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:04:51.570629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1659171151 Sep 14 01:04:51.570629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 9a61a5cdab00450abcb069278b29edf3 Sep 14 01:04:51.570629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1659171151 Sep 14 01:04:51.570629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-VolumesSnapshotsTestJSON-1659171151-project Sep 14 01:04:51.570629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:04:51.570629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:04:51.570629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: 50f5d7492f704f15b82127fa1c724f38 Sep 14 01:04:51.570629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1659171151-project Sep 14 01:04:51.570629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: Sep 14 01:04:51.570629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Snapshot ec3f0c94-f647-4c65-aaad-83394848661a could not be found. Sep 14 01:04:51.570629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': 'ec3f0c94-f647-4c65-aaad-83394848661a'} Sep 14 01:04:51.570629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:04:51.571422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:04:51.571422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 14 01:04:51.571422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 14 01:04:51.571422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 14 01:04:51.571422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 14 01:04:51.571422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 14 01:04:51.571422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 14 01:04:51.571422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 01:04:51.571422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 01:04:51.571422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 01:04:51.571422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 01:04:51.571422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 01:04:51.571422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 01:04:51.571422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 01:04:51.571422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 01:04:51.571422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ec3f0c94-f647-4c65-aaad-83394848661a could not be found. (HTTP 404) (Request-ID: req-65a0947f-35dc-48dd-8d36-a4cd6fdec121) Sep 14 01:04:51.571422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:51.571422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:04:51.572610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:51.572610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:04:51.572610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 14 01:04:51.572610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 14 01:04:51.572610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 01:04:51.572610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 01:04:51.572610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 14 01:04:51.572610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 14 01:04:51.572610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 01:04:51.572610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 01:04:51.572610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 14 01:04:51.572610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 14 01:04:51.572610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 14 01:04:51.572610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 14 01:04:51.572610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 14 01:04:51.572610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 14 01:04:51.572610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 01:04:51.572610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 01:04:51.572610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 01:04:51.573722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 01:04:51.573722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 01:04:51.573722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 01:04:51.573722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 01:04:51.573722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 01:04:51.573722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ec3f0c94-f647-4c65-aaad-83394848661a could not be found. Sep 14 01:04:51.573722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:51.573722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:04:51.573722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:51.573722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:04:51.573722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:04:51.573722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:04:51.573722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:04:51.573722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:04:51.573722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 01:04:51.573722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 01:04:51.573722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:04:51.573722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:04:51.573722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 14 01:04:51.573722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:04:51.574884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ec3f0c94-f647-4c65-aaad-83394848661a could not be found. Sep 14 01:04:51.574884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:51.574884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:04:51.574884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:51.574884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:04:51.574884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:04:51.574884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:04:51.574884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:04:51.574884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:04:51.574884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ec3f0c94-f647-4c65-aaad-83394848661a could not be found. Sep 14 01:04:51.574884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:51.577354 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f9418d64-f4f4-4f0e-a99a-80a40618367d tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Returning 404 to user: Snapshot ec3f0c94-f647-4c65-aaad-83394848661a could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:04:51.579617 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f9418d64-f4f4-4f0e-a99a-80a40618367d tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a" status: 404 len: 111 microversion: 2.1 time: 0.540406 Sep 14 01:04:51.580711 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 14/24] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Sep 14 01:04:51 2022] GET /compute/v2.1/os-snapshots/ec3f0c94-f647-4c65-aaad-83394848661a => generated 111 bytes in 543 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:04:51.592759 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-33b8f0cc-6aaa-4107-9479-e5e16217d10e tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Calling method '.version_select at 0x7f5048c754c0>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:51.864827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-33b8f0cc-6aaa-4107-9479-e5e16217d10e tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/717e1e38-fe39-4bd3-a250-ea76db78b9c5" status: 202 len: 0 microversion: 2.1 time: 0.279683 Sep 14 01:04:51.865739 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 11/25] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Sep 14 01:04:51 2022] DELETE /compute/v2.1/os-volumes/717e1e38-fe39-4bd3-a250-ea76db78b9c5 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:04:51.875041 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-dad6a460-8e46-4dc3-8307-48f74e513127 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Calling method '.version_select at 0x7f5048c0eee0>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:51.988270 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-dad6a460-8e46-4dc3-8307-48f74e513127 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/717e1e38-fe39-4bd3-a250-ea76db78b9c5" status: 200 len: 344 microversion: 2.1 time: 0.116774 Sep 14 01:04:51.989425 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 15/26] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 01:04:51 2022] GET /compute/v2.1/os-volumes/717e1e38-fe39-4bd3-a250-ea76db78b9c5 => generated 344 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:04:52.457216 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4114b912-5462-470f-a589-6c383821790d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Action: 'create', calling method: .version_select at 0x7f5048c75c10>, body: {"keypair": {"name": "tempest-keypair-1814663207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+hz5QBa2QYLke4888x9Dl52Q7aSG4AJHAXmaEdGTV4KiHLySfcOz0qluiQarGwMvd1S/nYnsoZRRI7uYlt/jz4bvSMDT/fgoW5bqlUYYoz+rmgXrd2CQVGeI6YRCfckg=="}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:04:52.548334 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-4114b912-5462-470f-a589-6c383821790d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Getting quotas for project 25c229f6a4574619a73b2780d2a6528b. Resources: {'key_pairs'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:04:52.557628 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-4114b912-5462-470f-a589-6c383821790d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Getting quotas for user 2eca12e1e0a64eeeb183a328f338f54d and project 25c229f6a4574619a73b2780d2a6528b. Resources: {'key_pairs'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:04:52.647010 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4114b912-5462-470f-a589-6c383821790d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.439288 Sep 14 01:04:52.658751 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 12/27] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Sep 14 01:04:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:04:53.005737 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-72fc9c54-3eea-4cd6-9f93-ae5723ef1c6f tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Calling method '.version_select at 0x7f5048c73a60>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:53.132808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-72fc9c54-3eea-4cd6-9f93-ae5723ef1c6f tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] HTTP exception thrown: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-72fc9c54-3eea-4cd6-9f93-ae5723ef1c6f tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Request method failure captured: Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/os-volumes/717e1e38-fe39-4bd3-a250-ea76db78b9c5 HTTP/1.1 Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISilQOcWZqpuqZjGrGxQqkG4S2YVMgZhc8WOU6CdetEgQj7ITxdJF8uq3JCOVuE1D1ZJ1YeZQAn6Lb8ud2rsyLJS4G8WaIxXooZ0l1ns5ZGUpIOdnruWBVhYGzE3m1tm9pV1W8xI-xnAYRSFuAwwAE8ghb-_HUTUdn9kMXHZCju1rG4 Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 9a61a5cdab00450abcb069278b29edf3 Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1659171151 Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:04:53.135003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:04:53.136361 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9a61a5cdab00450abcb069278b29edf3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9a61a5cdab00450abcb069278b29edf3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9a61a5cdab00450abcb069278b29edf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9a61a5cdab00450abcb069278b29edf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:04:53.136361 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1659171151 Sep 14 01:04:53.136361 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 9a61a5cdab00450abcb069278b29edf3 Sep 14 01:04:53.136361 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1659171151 Sep 14 01:04:53.136361 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-VolumesSnapshotsTestJSON-1659171151-project Sep 14 01:04:53.136361 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:04:53.136361 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:04:53.136361 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: 50f5d7492f704f15b82127fa1c724f38 Sep 14 01:04:53.136361 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1659171151-project Sep 14 01:04:53.136361 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: Sep 14 01:04:53.136361 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. Sep 14 01:04:53.136361 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': '717e1e38-fe39-4bd3-a250-ea76db78b9c5'} Sep 14 01:04:53.136361 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:04:53.137143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:04:53.137143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 01:04:53.137143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 01:04:53.137143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 01:04:53.137143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 01:04:53.137143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 01:04:53.137143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 01:04:53.137143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 01:04:53.137143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 01:04:53.137143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 01:04:53.137143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 01:04:53.137143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 01:04:53.137143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 01:04:53.137143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 01:04:53.137143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 01:04:53.137143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. (HTTP 404) (Request-ID: req-d80947d4-7617-40d7-a7b5-ac1508655cdd) Sep 14 01:04:53.137143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.137143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:04:53.137143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.138277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:04:53.138277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 14 01:04:53.138277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 14 01:04:53.138277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 01:04:53.138277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 01:04:53.138277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 01:04:53.138277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 01:04:53.138277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 01:04:53.138277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 01:04:53.138277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 01:04:53.138277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 01:04:53.138277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 01:04:53.138277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 01:04:53.138277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 01:04:53.138277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 01:04:53.138277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 01:04:53.138277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 01:04:53.138277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 01:04:53.138277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 01:04:53.139443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 01:04:53.139443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 01:04:53.139443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 01:04:53.139443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 01:04:53.139443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. Sep 14 01:04:53.139443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.139443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:04:53.139443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.139443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:04:53.139443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:04:53.139443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:04:53.139443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:04:53.139443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:04:53.139443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 01:04:53.139443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 01:04:53.139443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:04:53.139443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:04:53.139443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 14 01:04:53.139443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:04:53.140933 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. Sep 14 01:04:53.140933 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.140933 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:04:53.140933 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.140933 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:04:53.140933 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:04:53.140933 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:04:53.140933 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:04:53.140933 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:04:53.140933 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. Sep 14 01:04:53.140933 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.142409 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-72fc9c54-3eea-4cd6-9f93-ae5723ef1c6f tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Returning 404 to user: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:04:53.143401 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-72fc9c54-3eea-4cd6-9f93-ae5723ef1c6f tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/717e1e38-fe39-4bd3-a250-ea76db78b9c5" status: 404 len: 109 microversion: 2.1 time: 0.143332 Sep 14 01:04:53.144117 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 16/28] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 01:04:52 2022] GET /compute/v2.1/os-volumes/717e1e38-fe39-4bd3-a250-ea76db78b9c5 => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:04:53.159679 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8ee62f5e-ab64-4ddd-b59e-aa8e5e2a6608 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Calling method '.version_select at 0x7f5048b8a550>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:53.605308 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-8ee62f5e-ab64-4ddd-b59e-aa8e5e2a6608 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] HTTP exception thrown: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8ee62f5e-ab64-4ddd-b59e-aa8e5e2a6608 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Request method failure captured: Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: DELETE /compute/v2.1/os-volumes/717e1e38-fe39-4bd3-a250-ea76db78b9c5 HTTP/1.1 Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISilQOcWZqpuqZjGrGxQqkG4S2YVMgZhc8WOU6CdetEgQj7ITxdJF8uq3JCOVuE1D1ZJ1YeZQAn6Lb8ud2rsyLJS4G8WaIxXooZ0l1ns5ZGUpIOdnruWBVhYGzE3m1tm9pV1W8xI-xnAYRSFuAwwAE8ghb-_HUTUdn9kMXHZCju1rG4 Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 9a61a5cdab00450abcb069278b29edf3 Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1659171151 Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:04:53.609588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:04:53.610661 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9a61a5cdab00450abcb069278b29edf3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9a61a5cdab00450abcb069278b29edf3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9a61a5cdab00450abcb069278b29edf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9a61a5cdab00450abcb069278b29edf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:04:53.610661 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1659171151 Sep 14 01:04:53.610661 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 9a61a5cdab00450abcb069278b29edf3 Sep 14 01:04:53.610661 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1659171151 Sep 14 01:04:53.610661 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-VolumesSnapshotsTestJSON-1659171151-project Sep 14 01:04:53.610661 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:04:53.610661 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:04:53.610661 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: 50f5d7492f704f15b82127fa1c724f38 Sep 14 01:04:53.610661 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1659171151-project Sep 14 01:04:53.610661 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: Sep 14 01:04:53.610661 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. Sep 14 01:04:53.610661 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': '717e1e38-fe39-4bd3-a250-ea76db78b9c5'} Sep 14 01:04:53.610661 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:04:53.611315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:04:53.611315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 01:04:53.611315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 01:04:53.611315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 01:04:53.611315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 01:04:53.611315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 01:04:53.611315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 01:04:53.611315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 01:04:53.611315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 01:04:53.611315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 01:04:53.611315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 01:04:53.611315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 01:04:53.611315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 01:04:53.611315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 01:04:53.611315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 01:04:53.611315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. (HTTP 404) (Request-ID: req-c007a978-3cda-4257-9035-faf1da2c0fbd) Sep 14 01:04:53.611315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.611315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:04:53.611315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.612612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:04:53.612612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 14 01:04:53.612612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 14 01:04:53.612612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 01:04:53.612612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 01:04:53.612612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 01:04:53.612612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 01:04:53.612612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 01:04:53.612612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 01:04:53.612612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 01:04:53.612612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 01:04:53.612612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 01:04:53.612612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 01:04:53.612612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 01:04:53.612612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 01:04:53.612612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 01:04:53.612612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 01:04:53.612612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 01:04:53.612612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 01:04:53.613529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 01:04:53.613529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 01:04:53.613529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 01:04:53.613529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 01:04:53.613529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. Sep 14 01:04:53.613529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.613529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:04:53.613529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.613529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:04:53.613529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:04:53.613529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:04:53.613529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:04:53.613529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:04:53.613529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 01:04:53.613529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 01:04:53.613529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:04:53.613529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:04:53.613529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 14 01:04:53.613529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:04:53.615031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. Sep 14 01:04:53.615031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.615031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:04:53.615031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.615031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:04:53.615031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:04:53.615031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:04:53.615031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:04:53.615031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:04:53.615031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. Sep 14 01:04:53.615031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.615031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8ee62f5e-ab64-4ddd-b59e-aa8e5e2a6608 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Returning 404 to user: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:04:53.615031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8ee62f5e-ab64-4ddd-b59e-aa8e5e2a6608 tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/717e1e38-fe39-4bd3-a250-ea76db78b9c5" status: 404 len: 109 microversion: 2.1 time: 0.455687 Sep 14 01:04:53.615031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 13/29] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Sep 14 01:04:53 2022] DELETE /compute/v2.1/os-volumes/717e1e38-fe39-4bd3-a250-ea76db78b9c5 => generated 109 bytes in 457 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:04:53.624317 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3d385e3d-df9e-4766-893a-40490debb44b tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Calling method '.version_select at 0x7f5048bf8040>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:04:53.727028 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-3d385e3d-df9e-4766-893a-40490debb44b tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] HTTP exception thrown: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3d385e3d-df9e-4766-893a-40490debb44b tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Request method failure captured: Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/os-volumes/717e1e38-fe39-4bd3-a250-ea76db78b9c5 HTTP/1.1 Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISilQOcWZqpuqZjGrGxQqkG4S2YVMgZhc8WOU6CdetEgQj7ITxdJF8uq3JCOVuE1D1ZJ1YeZQAn6Lb8ud2rsyLJS4G8WaIxXooZ0l1ns5ZGUpIOdnruWBVhYGzE3m1tm9pV1W8xI-xnAYRSFuAwwAE8ghb-_HUTUdn9kMXHZCju1rG4 Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 9a61a5cdab00450abcb069278b29edf3 Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1659171151 Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:04:53.729034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:04:53.730330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9a61a5cdab00450abcb069278b29edf3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9a61a5cdab00450abcb069278b29edf3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9a61a5cdab00450abcb069278b29edf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9a61a5cdab00450abcb069278b29edf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:04:53.730330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1659171151 Sep 14 01:04:53.730330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 9a61a5cdab00450abcb069278b29edf3 Sep 14 01:04:53.730330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1659171151 Sep 14 01:04:53.730330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-VolumesSnapshotsTestJSON-1659171151-project Sep 14 01:04:53.730330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:04:53.730330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:04:53.730330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: 50f5d7492f704f15b82127fa1c724f38 Sep 14 01:04:53.730330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1659171151-project Sep 14 01:04:53.730330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: Sep 14 01:04:53.730330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. Sep 14 01:04:53.730330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': '717e1e38-fe39-4bd3-a250-ea76db78b9c5'} Sep 14 01:04:53.730330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:04:53.731016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:04:53.731016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 01:04:53.731016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 01:04:53.731016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 01:04:53.731016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 01:04:53.731016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 01:04:53.731016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 01:04:53.731016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 01:04:53.731016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 01:04:53.731016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 01:04:53.731016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 01:04:53.731016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 01:04:53.731016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 01:04:53.731016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 01:04:53.731016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 01:04:53.731016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. (HTTP 404) (Request-ID: req-a0c892d4-99c5-49bc-b570-dfc5b6cf88c3) Sep 14 01:04:53.731016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.731016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:04:53.731016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.731942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:04:53.731942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 14 01:04:53.731942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 14 01:04:53.731942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 01:04:53.731942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 01:04:53.731942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 01:04:53.731942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 01:04:53.731942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 01:04:53.731942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 01:04:53.731942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 01:04:53.731942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 01:04:53.731942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 01:04:53.731942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 01:04:53.731942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 01:04:53.731942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 01:04:53.731942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 01:04:53.731942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 01:04:53.731942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 01:04:53.731942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 01:04:53.732808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 01:04:53.732808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 01:04:53.732808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 01:04:53.732808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 01:04:53.732808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. Sep 14 01:04:53.732808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.732808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:04:53.732808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.732808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:04:53.732808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:04:53.732808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:04:53.732808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:04:53.732808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:04:53.732808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 01:04:53.732808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 01:04:53.732808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:04:53.732808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:04:53.732808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 14 01:04:53.732808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:04:53.733722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. Sep 14 01:04:53.733722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.733722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:04:53.733722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.733722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:04:53.733722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:04:53.733722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:04:53.733722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:04:53.733722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:04:53.733722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. Sep 14 01:04:53.733722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:04:53.736365 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3d385e3d-df9e-4766-893a-40490debb44b tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] Returning 404 to user: Volume 717e1e38-fe39-4bd3-a250-ea76db78b9c5 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:04:53.737048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3d385e3d-df9e-4766-893a-40490debb44b tempest-VolumesSnapshotsTestJSON-1659171151 tempest-VolumesSnapshotsTestJSON-1659171151-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/717e1e38-fe39-4bd3-a250-ea76db78b9c5" status: 404 len: 109 microversion: 2.1 time: 0.120927 Sep 14 01:04:53.742622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 17/30] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 01:04:53 2022] GET /compute/v2.1/os-volumes/717e1e38-fe39-4bd3-a250-ea76db78b9c5 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:04:56.026091 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-cf77abeb-6794-4004-9fb5-498487fb215c tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-526691871", "imageRef": "a2619027-0d8b-4ca3-9528-1ac3380cab5a", "flavorRef": "452", "networks": [{"uuid": "11c04de1-f8e8-4b37-991f-4682013f39d6"}]}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:04:56.065930 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9fd164b3-c54d-4f74-aea0-470292948ebe tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Action: 'create', calling method: .version_select at 0x7f5048b6c8b0>, body: {"keypair": {"name": "tempest-keypair-1898204071", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPntrBGfyMX9FTfOYk6Anixagng6g3YITOX724VjBPQkRT+atr2hWlH3+fEf9aG6jsKH2CI/rX6le9M+nU13HxlXBjpfN2XtJZJpuSuLGHkxCaBMtQQmeLnsEr3ZAMj2cg=="}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:04:56.130492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-9fd164b3-c54d-4f74-aea0-470292948ebe tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Getting quotas for project 62cb41eb4b8244abb4aafd718b1207ad. Resources: {'key_pairs'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:04:56.150447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-9fd164b3-c54d-4f74-aea0-470292948ebe tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Getting quotas for user 51768890f19140b6819ef89f5bf610c8 and project 62cb41eb4b8244abb4aafd718b1207ad. Resources: {'key_pairs'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:04:56.227183 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9fd164b3-c54d-4f74-aea0-470292948ebe tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.637025 Sep 14 01:04:56.228423 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 14/31] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Sep 14 01:04:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:04:56.378779 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-cf77abeb-6794-4004-9fb5-498487fb215c tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] validate_networks() for [('11c04de1-f8e8-4b37-991f-4682013f39d6', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:04:56.782691 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4d43c1ad-9e84-41b9-879f-0f92d1b3c9b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1228165651", "imageRef": "a2619027-0d8b-4ca3-9528-1ac3380cab5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:04:57.008866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.network.neutron [None req-4d43c1ad-9e84-41b9-879f-0f92d1b3c9b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] validate_networks() for [('2601f91b-34fe-45a9-9f56-15ca3eaf5c1d', None, None, None, None, None)] {{(pid=120620) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:04:59.254544 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-cf77abeb-6794-4004-9fb5-498487fb215c tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:04:59.255137 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-cf77abeb-6794-4004-9fb5-498487fb215c tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:04:59.256033 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-cf77abeb-6794-4004-9fb5-498487fb215c tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:04:59.257456 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-cf77abeb-6794-4004-9fb5-498487fb215c tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:04:59.257944 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-cf77abeb-6794-4004-9fb5-498487fb215c tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:04:59.300213 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cf77abeb-6794-4004-9fb5-498487fb215c tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:04:59.318803 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cf77abeb-6794-4004-9fb5-498487fb215c tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:04:59.321555 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cf77abeb-6794-4004-9fb5-498487fb215c tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:04:59.327578 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cf77abeb-6794-4004-9fb5-498487fb215c tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:04:59.331516 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cf77abeb-6794-4004-9fb5-498487fb215c tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:04:59.333870 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cf77abeb-6794-4004-9fb5-498487fb215c tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:04:59.411417 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-cf77abeb-6794-4004-9fb5-498487fb215c tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Getting quotas for project 832072fd5b984b5b91d249c5733452b8. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:04:59.423292 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-cf77abeb-6794-4004-9fb5-498487fb215c tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Getting quotas for user 017a9de44877436fa9531beb756c54c2 and project 832072fd5b984b5b91d249c5733452b8. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:04:59.437349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-cf77abeb-6794-4004-9fb5-498487fb215c tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:04:59.440622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-cf77abeb-6794-4004-9fb5-498487fb215c tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a2619027-0d8b-4ca3-9528-1ac3380cab5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:04:59.585230 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-4d43c1ad-9e84-41b9-879f-0f92d1b3c9b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Flavor limits 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:04:59.586392 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-4d43c1ad-9e84-41b9-879f-0f92d1b3c9b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Image limits 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:04:59.587259 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-4d43c1ad-9e84-41b9-879f-0f92d1b3c9b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Flavor pref 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:04:59.588819 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-4d43c1ad-9e84-41b9-879f-0f92d1b3c9b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Image pref 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:04:59.589610 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-4d43c1ad-9e84-41b9-879f-0f92d1b3c9b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:04:59.592409 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-cf77abeb-6794-4004-9fb5-498487fb215c tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.923129 Sep 14 01:04:59.595715 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 18/32] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 01:04:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 01:04:59.617423 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d43c1ad-9e84-41b9-879f-0f92d1b3c9b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:04:59.618832 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d43c1ad-9e84-41b9-879f-0f92d1b3c9b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:04:59.619900 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d43c1ad-9e84-41b9-879f-0f92d1b3c9b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:04:59.621708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d43c1ad-9e84-41b9-879f-0f92d1b3c9b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:04:59.622715 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d43c1ad-9e84-41b9-879f-0f92d1b3c9b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:04:59.623381 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d43c1ad-9e84-41b9-879f-0f92d1b3c9b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:04:59.661092 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-4d43c1ad-9e84-41b9-879f-0f92d1b3c9b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Getting quotas for project d1dd868f069a46dbb6bfd549f6bbf7b8. Resources: {'cores', 'instances', 'ram'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:04:59.666790 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-4d43c1ad-9e84-41b9-879f-0f92d1b3c9b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Getting quotas for user bf73eca572454b88843785d791f0b471 and project d1dd868f069a46dbb6bfd549f6bbf7b8. Resources: {'cores', 'instances', 'ram'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:04:59.682840 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4d43c1ad-9e84-41b9-879f-0f92d1b3c9b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Going to run 1 instances... {{(pid=120620) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:04:59.686070 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4d43c1ad-9e84-41b9-879f-0f92d1b3c9b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a2619027-0d8b-4ca3-9528-1ac3380cab5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120620) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:04:59.848735 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4d43c1ad-9e84-41b9-879f-0f92d1b3c9b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.257731 Sep 14 01:04:59.849596 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 15/33] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 01:04:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 3259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 01:04:59.883208 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6c8156f5-9d13-4dcb-8839-a3a22037e3a3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-935136124", "imageRef": "a2619027-0d8b-4ca3-9528-1ac3380cab5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "740eb1f7-47cc-47b7-ac3a-115438e4b57e"}], "security_groups": [{"name": "tempest-securitygroup--421349149"}], "key_name": "tempest-keypair-1814663207", "user_data": "}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:00.320731 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b156d2ce-7fb8-4c25-8137-48d8caeb20ed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Action: 'create', calling method: .version_select at 0x7f5048b041f0>, body: {"keypair": {"name": "tempest-keypair-488413779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJscjFcgajSibAqsl0eKL10UUfXgnAgN2CUOWJmN7nbfmdgYp5ruHnGoSkdEQqIuMDuivBHt9daG/TO4NMue4DCRiwm9iKccHZPL6nvUm9Tl8zB4/gkDsS9KLsLcQ+sHUA=="}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:00.420396 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-b156d2ce-7fb8-4c25-8137-48d8caeb20ed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Getting quotas for project 3c6482bb91c24939ba18c03a3e5bb18c. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:05:00.429848 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-b156d2ce-7fb8-4c25-8137-48d8caeb20ed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Getting quotas for user e4ad2d06f62246be8eb162257cbb4f8e and project 3c6482bb91c24939ba18c03a3e5bb18c. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:05:00.511444 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b156d2ce-7fb8-4c25-8137-48d8caeb20ed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.911144 Sep 14 01:05:00.512351 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 19/34] 10.222.0.42 () {62 vars in 1200 bytes} [Wed Sep 14 01:04:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 916 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 01:05:00.518080 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2b2e3002-61fe-48f0-9c87-a2f6ed6efae8 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:00.520307 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2b2e3002-61fe-48f0-9c87-a2f6ed6efae8 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:00.529435 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.network.neutron [None req-6c8156f5-9d13-4dcb-8839-a3a22037e3a3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] validate_networks() for [('740eb1f7-47cc-47b7-ac3a-115438e4b57e', None, None, None, None, None)] {{(pid=120620) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:05:00.733301 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2b2e3002-61fe-48f0-9c87-a2f6ed6efae8 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:00.764384 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2b2e3002-61fe-48f0-9c87-a2f6ed6efae8 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1214 microversion: 2.1 time: 0.250518 Sep 14 01:05:00.767074 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 20/35] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:00 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1214 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:00.785287 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-db75f392-3faf-4324-9574-6759033cb6b2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:00.786967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-db75f392-3faf-4324-9574-6759033cb6b2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:00.898557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-db75f392-3faf-4324-9574-6759033cb6b2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:00.909998 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-db75f392-3faf-4324-9574-6759033cb6b2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1222 microversion: 2.1 time: 0.139080 Sep 14 01:05:00.912379 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 21/36] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:00 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1222 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:01.303610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fdc07862-b6de-45ec-b4eb-e0473459b659 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-460518983", "imageRef": "a2619027-0d8b-4ca3-9528-1ac3380cab5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:01.405569 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-fdc07862-b6de-45ec-b4eb-e0473459b659 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] validate_networks() for [('2601f91b-34fe-45a9-9f56-15ca3eaf5c1d', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:05:01.881687 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-6c8156f5-9d13-4dcb-8839-a3a22037e3a3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Flavor limits 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:05:01.882633 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-6c8156f5-9d13-4dcb-8839-a3a22037e3a3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Image limits 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:05:01.887298 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-6c8156f5-9d13-4dcb-8839-a3a22037e3a3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Flavor pref 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:05:01.887859 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-6c8156f5-9d13-4dcb-8839-a3a22037e3a3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Image pref 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:05:01.888382 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-6c8156f5-9d13-4dcb-8839-a3a22037e3a3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:05:01.909789 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6c8156f5-9d13-4dcb-8839-a3a22037e3a3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:01.910438 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6c8156f5-9d13-4dcb-8839-a3a22037e3a3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:01.911001 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6c8156f5-9d13-4dcb-8839-a3a22037e3a3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:01.912024 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6c8156f5-9d13-4dcb-8839-a3a22037e3a3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:01.912627 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6c8156f5-9d13-4dcb-8839-a3a22037e3a3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:01.913699 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6c8156f5-9d13-4dcb-8839-a3a22037e3a3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:01.939280 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-6c8156f5-9d13-4dcb-8839-a3a22037e3a3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Getting quotas for project 25c229f6a4574619a73b2780d2a6528b. Resources: {'cores', 'instances', 'ram'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:05:01.943784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-6c8156f5-9d13-4dcb-8839-a3a22037e3a3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Getting quotas for user 2eca12e1e0a64eeeb183a328f338f54d and project 25c229f6a4574619a73b2780d2a6528b. Resources: {'cores', 'instances', 'ram'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:05:01.957612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-6c8156f5-9d13-4dcb-8839-a3a22037e3a3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Going to run 1 instances... {{(pid=120620) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:05:01.961031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-6c8156f5-9d13-4dcb-8839-a3a22037e3a3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a2619027-0d8b-4ca3-9528-1ac3380cab5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120620) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:05:02.019451 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-6c8156f5-9d13-4dcb-8839-a3a22037e3a3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.159767 Sep 14 01:05:02.020519 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 16/37] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 01:04:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 2171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 01:05:02.030920 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7e5e235c-983e-4b5c-9499-63909eb0673e tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:02.031568 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7e5e235c-983e-4b5c-9499-63909eb0673e tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:02.217035 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7e5e235c-983e-4b5c-9499-63909eb0673e tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:02.254420 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7e5e235c-983e-4b5c-9499-63909eb0673e tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1214 microversion: 2.1 time: 0.232495 Sep 14 01:05:02.266239 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 17/38] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:02 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1214 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:02.283111 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e4cd0163-cf78-4821-9a24-c1971b5be137 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:02.283767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-e4cd0163-cf78-4821-9a24-c1971b5be137 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:02.383344 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e4cd0163-cf78-4821-9a24-c1971b5be137 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:02.396323 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-e4cd0163-cf78-4821-9a24-c1971b5be137 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1237 microversion: 2.1 time: 0.128909 Sep 14 01:05:02.396916 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 18/39] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:02 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1237 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:02.405617 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-165a3a9c-20bc-418d-9df8-408f5f5c60c9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1139354203", "imageRef": "a2619027-0d8b-4ca3-9528-1ac3380cab5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a458fb77-0452-4eef-a570-bd92e833719b"}], "security_groups": [{"name": "tempest-securitygroup--2103202672"}], "key_name": "tempest-keypair-1898204071", "user_data": "}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:02.565190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.network.neutron [None req-165a3a9c-20bc-418d-9df8-408f5f5c60c9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] validate_networks() for [('a458fb77-0452-4eef-a570-bd92e833719b', None, None, None, None, None)] {{(pid=120620) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:05:02.652291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-fdc07862-b6de-45ec-b4eb-e0473459b659 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:05:02.653335 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-fdc07862-b6de-45ec-b4eb-e0473459b659 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:05:02.654068 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-fdc07862-b6de-45ec-b4eb-e0473459b659 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:05:02.654636 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-fdc07862-b6de-45ec-b4eb-e0473459b659 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:05:02.655214 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-fdc07862-b6de-45ec-b4eb-e0473459b659 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:05:02.677542 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fdc07862-b6de-45ec-b4eb-e0473459b659 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:02.683196 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fdc07862-b6de-45ec-b4eb-e0473459b659 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:02.683681 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fdc07862-b6de-45ec-b4eb-e0473459b659 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:02.688282 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fdc07862-b6de-45ec-b4eb-e0473459b659 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:02.689632 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fdc07862-b6de-45ec-b4eb-e0473459b659 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:02.690140 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fdc07862-b6de-45ec-b4eb-e0473459b659 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:02.745892 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-fdc07862-b6de-45ec-b4eb-e0473459b659 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Getting quotas for project d1dd868f069a46dbb6bfd549f6bbf7b8. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:05:02.752963 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-fdc07862-b6de-45ec-b4eb-e0473459b659 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Getting quotas for user bf73eca572454b88843785d791f0b471 and project d1dd868f069a46dbb6bfd549f6bbf7b8. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:05:02.794935 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fdc07862-b6de-45ec-b4eb-e0473459b659 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:05:02.801240 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fdc07862-b6de-45ec-b4eb-e0473459b659 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a2619027-0d8b-4ca3-9528-1ac3380cab5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:05:02.880206 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fdc07862-b6de-45ec-b4eb-e0473459b659 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.583194 Sep 14 01:05:02.882507 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 22/40] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 01:05:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 1586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 01:05:02.901020 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-35430153-79ab-4347-9d51-5ec36c8d02bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:02.902098 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-35430153-79ab-4347-9d51-5ec36c8d02bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:03.346044 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-165a3a9c-20bc-418d-9df8-408f5f5c60c9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Flavor limits 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:05:03.347054 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-165a3a9c-20bc-418d-9df8-408f5f5c60c9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Image limits 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:05:03.347757 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-165a3a9c-20bc-418d-9df8-408f5f5c60c9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Flavor pref 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:05:03.355520 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-165a3a9c-20bc-418d-9df8-408f5f5c60c9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Image pref 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:05:03.356214 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-165a3a9c-20bc-418d-9df8-408f5f5c60c9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:05:03.379645 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-165a3a9c-20bc-418d-9df8-408f5f5c60c9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:03.381647 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-165a3a9c-20bc-418d-9df8-408f5f5c60c9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:03.383380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-165a3a9c-20bc-418d-9df8-408f5f5c60c9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:03.384967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-165a3a9c-20bc-418d-9df8-408f5f5c60c9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:03.386706 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-165a3a9c-20bc-418d-9df8-408f5f5c60c9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:03.388886 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-165a3a9c-20bc-418d-9df8-408f5f5c60c9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:03.472346 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-165a3a9c-20bc-418d-9df8-408f5f5c60c9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Getting quotas for project 62cb41eb4b8244abb4aafd718b1207ad. Resources: {'cores', 'instances', 'ram'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:05:03.481391 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-35430153-79ab-4347-9d51-5ec36c8d02bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:03.486187 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-165a3a9c-20bc-418d-9df8-408f5f5c60c9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Getting quotas for user 51768890f19140b6819ef89f5bf610c8 and project 62cb41eb4b8244abb4aafd718b1207ad. Resources: {'cores', 'instances', 'ram'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:05:03.508367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-35430153-79ab-4347-9d51-5ec36c8d02bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1221 microversion: 2.1 time: 0.610918 Sep 14 01:05:03.511367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 23/41] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:02 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1221 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:03.531901 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-aef70008-4c9a-4b2b-b919-9dc95be7174d tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:03.534431 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-aef70008-4c9a-4b2b-b919-9dc95be7174d tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:03.534997 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-165a3a9c-20bc-418d-9df8-408f5f5c60c9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Going to run 1 instances... {{(pid=120620) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:05:03.542234 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-165a3a9c-20bc-418d-9df8-408f5f5c60c9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a2619027-0d8b-4ca3-9528-1ac3380cab5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120620) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:05:03.580598 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aef70008-4c9a-4b2b-b919-9dc95be7174d tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:03.582944 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aef70008-4c9a-4b2b-b919-9dc95be7174d tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:03.586431 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aef70008-4c9a-4b2b-b919-9dc95be7174d tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:03.588261 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aef70008-4c9a-4b2b-b919-9dc95be7174d tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:03.591023 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aef70008-4c9a-4b2b-b919-9dc95be7174d tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:03.592450 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aef70008-4c9a-4b2b-b919-9dc95be7174d tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:03.767285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-165a3a9c-20bc-418d-9df8-408f5f5c60c9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.366242 Sep 14 01:05:03.779653 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 19/42] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 01:05:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 1380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 01:05:03.787443 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4d20a1bb-2f9f-4c35-8e87-c52e02339c1f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:03.788934 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4d20a1bb-2f9f-4c35-8e87-c52e02339c1f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:03.924618 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4d20a1bb-2f9f-4c35-8e87-c52e02339c1f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:03.940516 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4d20a1bb-2f9f-4c35-8e87-c52e02339c1f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1237 microversion: 2.1 time: 0.157118 Sep 14 01:05:03.942148 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 20/43] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:03 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1237 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:03.955095 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-24150638-ffc0-4f05-bdfe-7984d7dc1bb0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:03.956112 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-24150638-ffc0-4f05-bdfe-7984d7dc1bb0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:04.066862 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-24150638-ffc0-4f05-bdfe-7984d7dc1bb0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:04.076415 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-24150638-ffc0-4f05-bdfe-7984d7dc1bb0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1242 microversion: 2.1 time: 0.131678 Sep 14 01:05:04.078722 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 21/44] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:03 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1242 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:04.089229 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-aef70008-4c9a-4b2b-b919-9dc95be7174d tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:04.105200 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-aef70008-4c9a-4b2b-b919-9dc95be7174d tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1210 microversion: 2.1 time: 0.592658 Sep 14 01:05:04.106598 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 24/45] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:03 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1210 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:04.123004 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-eb18d8e5-347f-4aa3-8dcf-187434c5603d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1755173629", "imageRef": "a2619027-0d8b-4ca3-9528-1ac3380cab5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c98240d0-3126-41fb-afde-91eebe272174"}], "security_groups": [{"name": "tempest-securitygroup--428052467"}], "key_name": "tempest-keypair-488413779", "user_data": "}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:04.293086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.network.neutron [None req-eb18d8e5-347f-4aa3-8dcf-187434c5603d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] validate_networks() for [('c98240d0-3126-41fb-afde-91eebe272174', None, None, None, None, None)] {{(pid=120620) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:05:04.533468 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-69f8c27a-dc3b-458a-8706-cd6cfd0fd8c5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:04.534091 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-69f8c27a-dc3b-458a-8706-cd6cfd0fd8c5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:04.548004 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69f8c27a-dc3b-458a-8706-cd6cfd0fd8c5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:04.548502 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69f8c27a-dc3b-458a-8706-cd6cfd0fd8c5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:04.548939 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69f8c27a-dc3b-458a-8706-cd6cfd0fd8c5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:04.549872 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69f8c27a-dc3b-458a-8706-cd6cfd0fd8c5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:04.550106 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69f8c27a-dc3b-458a-8706-cd6cfd0fd8c5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:04.551979 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-69f8c27a-dc3b-458a-8706-cd6cfd0fd8c5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:04.634127 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-69f8c27a-dc3b-458a-8706-cd6cfd0fd8c5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:04.647349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-69f8c27a-dc3b-458a-8706-cd6cfd0fd8c5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1217 microversion: 2.1 time: 0.118985 Sep 14 01:05:04.648789 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 25/46] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:04 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1217 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:04.969482 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-bb791bf3-84f0-4e45-ade8-3aaecd3e1bb0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:04.971426 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-bb791bf3-84f0-4e45-ade8-3aaecd3e1bb0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:04.985737 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bb791bf3-84f0-4e45-ade8-3aaecd3e1bb0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:04.986518 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bb791bf3-84f0-4e45-ade8-3aaecd3e1bb0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:04.987160 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bb791bf3-84f0-4e45-ade8-3aaecd3e1bb0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:04.988071 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bb791bf3-84f0-4e45-ade8-3aaecd3e1bb0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:04.997452 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-eb18d8e5-347f-4aa3-8dcf-187434c5603d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Flavor limits 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:05:04.998099 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-eb18d8e5-347f-4aa3-8dcf-187434c5603d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Image limits 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:05:04.998584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-eb18d8e5-347f-4aa3-8dcf-187434c5603d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Flavor pref 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:05:04.999001 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-eb18d8e5-347f-4aa3-8dcf-187434c5603d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Image pref 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:05:04.999422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-eb18d8e5-347f-4aa3-8dcf-187434c5603d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:05:05.000195 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bb791bf3-84f0-4e45-ade8-3aaecd3e1bb0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:05.000831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bb791bf3-84f0-4e45-ade8-3aaecd3e1bb0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:05.026806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eb18d8e5-347f-4aa3-8dcf-187434c5603d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:05.027299 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eb18d8e5-347f-4aa3-8dcf-187434c5603d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:05.027770 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eb18d8e5-347f-4aa3-8dcf-187434c5603d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:05.037302 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eb18d8e5-347f-4aa3-8dcf-187434c5603d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:05.040451 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eb18d8e5-347f-4aa3-8dcf-187434c5603d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:05.042923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eb18d8e5-347f-4aa3-8dcf-187434c5603d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:05.094656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:05.107447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-eb18d8e5-347f-4aa3-8dcf-187434c5603d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Getting quotas for project 3c6482bb91c24939ba18c03a3e5bb18c. Resources: {'cores', 'instances', 'ram'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:05:05.114047 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-eb18d8e5-347f-4aa3-8dcf-187434c5603d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Getting quotas for user e4ad2d06f62246be8eb162257cbb4f8e and project 3c6482bb91c24939ba18c03a3e5bb18c. Resources: {'cores', 'instances', 'ram'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:05:05.137933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-eb18d8e5-347f-4aa3-8dcf-187434c5603d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Going to run 1 instances... {{(pid=120620) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:05:05.141240 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-eb18d8e5-347f-4aa3-8dcf-187434c5603d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a2619027-0d8b-4ca3-9528-1ac3380cab5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120620) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:05:05.299692 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-eb18d8e5-347f-4aa3-8dcf-187434c5603d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.219575 Sep 14 01:05:05.300401 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 22/47] 10.222.0.42 () {62 vars in 1188 bytes} [Wed Sep 14 01:05:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 01:05:05.315835 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-87a9300e-45d7-4121-85db-865448f2480a tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:05.316451 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-87a9300e-45d7-4121-85db-865448f2480a tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:05.363888 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-87a9300e-45d7-4121-85db-865448f2480a tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:05.364388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-87a9300e-45d7-4121-85db-865448f2480a tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:05.369809 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-87a9300e-45d7-4121-85db-865448f2480a tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:05.372212 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-87a9300e-45d7-4121-85db-865448f2480a tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:05.372833 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-87a9300e-45d7-4121-85db-865448f2480a tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:05.375188 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-87a9300e-45d7-4121-85db-865448f2480a tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:05.445500 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-bb791bf3-84f0-4e45-ade8-3aaecd3e1bb0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:05.464238 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-bb791bf3-84f0-4e45-ade8-3aaecd3e1bb0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1233 microversion: 2.1 time: 0.497566 Sep 14 01:05:05.480649 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 26/48] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:04 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1233 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:05.482149 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1e9706f9-515e-4ef6-ab84-b84f5a4dbe03 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:05.483093 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1e9706f9-515e-4ef6-ab84-b84f5a4dbe03 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:05.496080 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1e9706f9-515e-4ef6-ab84-b84f5a4dbe03 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:05.496588 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1e9706f9-515e-4ef6-ab84-b84f5a4dbe03 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:05.497121 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1e9706f9-515e-4ef6-ab84-b84f5a4dbe03 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:05.497915 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1e9706f9-515e-4ef6-ab84-b84f5a4dbe03 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:05.498579 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1e9706f9-515e-4ef6-ab84-b84f5a4dbe03 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:05.499020 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1e9706f9-515e-4ef6-ab84-b84f5a4dbe03 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:05.591707 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-87a9300e-45d7-4121-85db-865448f2480a tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:05.605638 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-87a9300e-45d7-4121-85db-865448f2480a tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1238 microversion: 2.1 time: 0.297397 Sep 14 01:05:05.606496 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 23/49] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:05 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1238 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:05.634552 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e770341d-3cda-48e5-80a5-508d794425bb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:05.637156 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-e770341d-3cda-48e5-80a5-508d794425bb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:05.752070 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e770341d-3cda-48e5-80a5-508d794425bb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:05.763613 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e770341d-3cda-48e5-80a5-508d794425bb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:05.766669 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e770341d-3cda-48e5-80a5-508d794425bb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:05.769433 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-e770341d-3cda-48e5-80a5-508d794425bb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1281 microversion: 2.20 time: 0.147038 Sep 14 01:05:05.770002 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 24/50] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:05 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1281 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:05.792074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-48487171-b898-477f-a0f1-d731acdfcb8c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:05.793032 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-48487171-b898-477f-a0f1-d731acdfcb8c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:05.804072 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-48487171-b898-477f-a0f1-d731acdfcb8c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:05.806090 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-48487171-b898-477f-a0f1-d731acdfcb8c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:05.824594 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-48487171-b898-477f-a0f1-d731acdfcb8c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:05.827111 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-48487171-b898-477f-a0f1-d731acdfcb8c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:05.827703 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-48487171-b898-477f-a0f1-d731acdfcb8c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:05.828401 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-48487171-b898-477f-a0f1-d731acdfcb8c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:05.865522 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1e9706f9-515e-4ef6-ab84-b84f5a4dbe03 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:05.878313 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1e9706f9-515e-4ef6-ab84-b84f5a4dbe03 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1266 microversion: 2.1 time: 0.411808 Sep 14 01:05:05.883653 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 27/51] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:05 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1266 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:06.041159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-48487171-b898-477f-a0f1-d731acdfcb8c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:06.050415 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-48487171-b898-477f-a0f1-d731acdfcb8c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1217 microversion: 2.1 time: 0.279152 Sep 14 01:05:06.059932 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 25/52] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:05 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1217 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:06.495542 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6da709f3-8a2e-4004-bc30-76d76616f570 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:06.498120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6da709f3-8a2e-4004-bc30-76d76616f570 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:06.513614 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6da709f3-8a2e-4004-bc30-76d76616f570 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:06.514245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6da709f3-8a2e-4004-bc30-76d76616f570 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:06.514969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6da709f3-8a2e-4004-bc30-76d76616f570 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:06.515876 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6da709f3-8a2e-4004-bc30-76d76616f570 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:06.516416 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6da709f3-8a2e-4004-bc30-76d76616f570 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:06.516911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6da709f3-8a2e-4004-bc30-76d76616f570 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:06.630702 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ec848e8f-48a8-498a-b3a1-6b35ac35be15 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:06.631700 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ec848e8f-48a8-498a-b3a1-6b35ac35be15 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:06.639128 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec848e8f-48a8-498a-b3a1-6b35ac35be15 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:06.641488 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec848e8f-48a8-498a-b3a1-6b35ac35be15 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:06.649865 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec848e8f-48a8-498a-b3a1-6b35ac35be15 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:06.651490 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec848e8f-48a8-498a-b3a1-6b35ac35be15 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:06.653755 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec848e8f-48a8-498a-b3a1-6b35ac35be15 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:06.654318 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec848e8f-48a8-498a-b3a1-6b35ac35be15 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:06.658872 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6da709f3-8a2e-4004-bc30-76d76616f570 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:06.676527 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6da709f3-8a2e-4004-bc30-76d76616f570 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1233 microversion: 2.1 time: 0.187111 Sep 14 01:05:06.700343 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 28/53] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:06 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1233 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:06.797191 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c3ea01a4-8e48-4e6c-9739-a9ac181a0afa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:06.798107 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c3ea01a4-8e48-4e6c-9739-a9ac181a0afa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:06.814246 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c3ea01a4-8e48-4e6c-9739-a9ac181a0afa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:06.815074 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c3ea01a4-8e48-4e6c-9739-a9ac181a0afa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:06.818210 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c3ea01a4-8e48-4e6c-9739-a9ac181a0afa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:06.819935 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c3ea01a4-8e48-4e6c-9739-a9ac181a0afa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:06.820750 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c3ea01a4-8e48-4e6c-9739-a9ac181a0afa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:06.821494 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c3ea01a4-8e48-4e6c-9739-a9ac181a0afa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:06.999779 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c3ea01a4-8e48-4e6c-9739-a9ac181a0afa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:07.017455 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c3ea01a4-8e48-4e6c-9739-a9ac181a0afa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:07.019899 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c3ea01a4-8e48-4e6c-9739-a9ac181a0afa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:07.024665 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c3ea01a4-8e48-4e6c-9739-a9ac181a0afa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1277 microversion: 2.20 time: 0.230686 Sep 14 01:05:07.025342 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 29/54] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:06 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1277 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:07.031146 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f2e12771-98fa-49b5-acac-74b8658f8ec0 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:07.032687 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f2e12771-98fa-49b5-acac-74b8658f8ec0 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:07.040907 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f2e12771-98fa-49b5-acac-74b8658f8ec0 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:07.041865 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f2e12771-98fa-49b5-acac-74b8658f8ec0 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:07.042628 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f2e12771-98fa-49b5-acac-74b8658f8ec0 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:07.043530 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f2e12771-98fa-49b5-acac-74b8658f8ec0 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:07.044312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f2e12771-98fa-49b5-acac-74b8658f8ec0 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:07.044918 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f2e12771-98fa-49b5-acac-74b8658f8ec0 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:07.064834 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ec848e8f-48a8-498a-b3a1-6b35ac35be15 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:07.081134 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ec848e8f-48a8-498a-b3a1-6b35ac35be15 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1238 microversion: 2.1 time: 0.454971 Sep 14 01:05:07.098019 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 26/55] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:06 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1238 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:07.112743 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ad14f8b7-55e2-45bf-8c04-69172d15c7f1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:07.116220 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ad14f8b7-55e2-45bf-8c04-69172d15c7f1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:07.132373 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ad14f8b7-55e2-45bf-8c04-69172d15c7f1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:07.133252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ad14f8b7-55e2-45bf-8c04-69172d15c7f1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:07.134924 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ad14f8b7-55e2-45bf-8c04-69172d15c7f1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:07.137202 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ad14f8b7-55e2-45bf-8c04-69172d15c7f1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:07.137895 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ad14f8b7-55e2-45bf-8c04-69172d15c7f1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:07.139921 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ad14f8b7-55e2-45bf-8c04-69172d15c7f1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:07.339233 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f2e12771-98fa-49b5-acac-74b8658f8ec0 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:07.359034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f2e12771-98fa-49b5-acac-74b8658f8ec0 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1272 microversion: 2.1 time: 0.332133 Sep 14 01:05:07.360330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 30/56] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:07 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1272 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:07.412052 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ad14f8b7-55e2-45bf-8c04-69172d15c7f1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:07.421999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ad14f8b7-55e2-45bf-8c04-69172d15c7f1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1273 microversion: 2.1 time: 0.322809 Sep 14 01:05:07.430010 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 27/57] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:07 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1273 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:07.708076 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-24efc15d-13b7-4c32-b145-166dce414c00 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:07.708704 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-24efc15d-13b7-4c32-b145-166dce414c00 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:07.723142 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-24efc15d-13b7-4c32-b145-166dce414c00 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:07.727893 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-24efc15d-13b7-4c32-b145-166dce414c00 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:07.729612 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-24efc15d-13b7-4c32-b145-166dce414c00 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:07.733400 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-24efc15d-13b7-4c32-b145-166dce414c00 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:07.734193 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-24efc15d-13b7-4c32-b145-166dce414c00 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:07.734871 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-24efc15d-13b7-4c32-b145-166dce414c00 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:07.869231 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-24efc15d-13b7-4c32-b145-166dce414c00 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:07.881051 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-24efc15d-13b7-4c32-b145-166dce414c00 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1233 microversion: 2.1 time: 0.176927 Sep 14 01:05:07.881957 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 31/58] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:07 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1233 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:08.056461 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-20934337-3eca-4239-ae33-c2a89f69a5fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:08.057359 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-20934337-3eca-4239-ae33-c2a89f69a5fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:08.067453 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-20934337-3eca-4239-ae33-c2a89f69a5fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:08.071451 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-20934337-3eca-4239-ae33-c2a89f69a5fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:08.072238 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-20934337-3eca-4239-ae33-c2a89f69a5fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:08.074870 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-20934337-3eca-4239-ae33-c2a89f69a5fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:08.076551 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-20934337-3eca-4239-ae33-c2a89f69a5fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:08.077754 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-20934337-3eca-4239-ae33-c2a89f69a5fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:08.109058 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3cfe5fa1-65cc-40fb-974e-3798a8da1510 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:08.109838 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3cfe5fa1-65cc-40fb-974e-3798a8da1510 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:08.117651 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3cfe5fa1-65cc-40fb-974e-3798a8da1510 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:08.120074 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3cfe5fa1-65cc-40fb-974e-3798a8da1510 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:08.121460 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3cfe5fa1-65cc-40fb-974e-3798a8da1510 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:08.124371 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3cfe5fa1-65cc-40fb-974e-3798a8da1510 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:08.127539 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3cfe5fa1-65cc-40fb-974e-3798a8da1510 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:08.128128 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3cfe5fa1-65cc-40fb-974e-3798a8da1510 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:08.280703 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3cfe5fa1-65cc-40fb-974e-3798a8da1510 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:08.293219 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3cfe5fa1-65cc-40fb-974e-3798a8da1510 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1238 microversion: 2.1 time: 0.187371 Sep 14 01:05:08.293810 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 32/59] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:08 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1238 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:08.321041 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-20934337-3eca-4239-ae33-c2a89f69a5fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:08.345764 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-20934337-3eca-4239-ae33-c2a89f69a5fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:08.353271 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-20934337-3eca-4239-ae33-c2a89f69a5fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:08.354446 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-20934337-3eca-4239-ae33-c2a89f69a5fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1277 microversion: 2.20 time: 0.303915 Sep 14 01:05:08.361435 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 28/60] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:08 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1277 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:08.386246 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-452da48c-6921-49e8-8c94-64168d3f0186 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:08.387154 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-452da48c-6921-49e8-8c94-64168d3f0186 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:08.395110 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-452da48c-6921-49e8-8c94-64168d3f0186 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:08.395896 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-452da48c-6921-49e8-8c94-64168d3f0186 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:08.396415 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-452da48c-6921-49e8-8c94-64168d3f0186 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:08.398124 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-452da48c-6921-49e8-8c94-64168d3f0186 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:08.398768 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-452da48c-6921-49e8-8c94-64168d3f0186 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:08.399280 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-452da48c-6921-49e8-8c94-64168d3f0186 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:08.458248 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a6c74663-0613-49c5-b830-8d1c6c21d1bf tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:08.458862 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a6c74663-0613-49c5-b830-8d1c6c21d1bf tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:08.467492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a6c74663-0613-49c5-b830-8d1c6c21d1bf tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:08.468205 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a6c74663-0613-49c5-b830-8d1c6c21d1bf tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:08.468786 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a6c74663-0613-49c5-b830-8d1c6c21d1bf tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:08.469679 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a6c74663-0613-49c5-b830-8d1c6c21d1bf tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:08.470266 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a6c74663-0613-49c5-b830-8d1c6c21d1bf tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:08.470821 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a6c74663-0613-49c5-b830-8d1c6c21d1bf tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:08.590023 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a6c74663-0613-49c5-b830-8d1c6c21d1bf tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:08.605808 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a6c74663-0613-49c5-b830-8d1c6c21d1bf tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1273 microversion: 2.1 time: 0.149948 Sep 14 01:05:08.619819 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 29/61] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:08 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1273 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:08.713427 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-452da48c-6921-49e8-8c94-64168d3f0186 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:08.721918 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-452da48c-6921-49e8-8c94-64168d3f0186 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 0.340954 Sep 14 01:05:08.722784 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 33/62] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:08 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:08.908330 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-70043fc4-5360-4a2b-b21e-a14bcf756689 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:08.909386 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-70043fc4-5360-4a2b-b21e-a14bcf756689 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:08.921029 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-70043fc4-5360-4a2b-b21e-a14bcf756689 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:08.922069 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-70043fc4-5360-4a2b-b21e-a14bcf756689 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:08.922543 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-70043fc4-5360-4a2b-b21e-a14bcf756689 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:08.924256 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-70043fc4-5360-4a2b-b21e-a14bcf756689 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:08.926315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-70043fc4-5360-4a2b-b21e-a14bcf756689 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:08.927162 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-70043fc4-5360-4a2b-b21e-a14bcf756689 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:09.014994 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-70043fc4-5360-4a2b-b21e-a14bcf756689 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:09.029528 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-70043fc4-5360-4a2b-b21e-a14bcf756689 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1233 microversion: 2.1 time: 0.127333 Sep 14 01:05:09.030198 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 30/63] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:08 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1233 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:09.317360 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-54c79992-30a3-4665-b3e9-6a60c9baa182 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:09.318266 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-54c79992-30a3-4665-b3e9-6a60c9baa182 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:09.325216 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54c79992-30a3-4665-b3e9-6a60c9baa182 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:09.325720 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54c79992-30a3-4665-b3e9-6a60c9baa182 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:09.327388 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54c79992-30a3-4665-b3e9-6a60c9baa182 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:09.328310 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54c79992-30a3-4665-b3e9-6a60c9baa182 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:09.328810 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54c79992-30a3-4665-b3e9-6a60c9baa182 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:09.329189 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54c79992-30a3-4665-b3e9-6a60c9baa182 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:09.389057 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-672b9037-8a89-48d6-8464-244c40a232b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:09.389927 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-672b9037-8a89-48d6-8464-244c40a232b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:09.398148 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-672b9037-8a89-48d6-8464-244c40a232b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:09.400052 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-672b9037-8a89-48d6-8464-244c40a232b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:09.400896 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-672b9037-8a89-48d6-8464-244c40a232b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:09.402059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-672b9037-8a89-48d6-8464-244c40a232b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:09.402524 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-672b9037-8a89-48d6-8464-244c40a232b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:09.403103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-672b9037-8a89-48d6-8464-244c40a232b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:09.439420 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-54c79992-30a3-4665-b3e9-6a60c9baa182 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:09.451077 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-54c79992-30a3-4665-b3e9-6a60c9baa182 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1238 microversion: 2.1 time: 0.134952 Sep 14 01:05:09.456231 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 34/64] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:09 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1238 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:09.524464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-672b9037-8a89-48d6-8464-244c40a232b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:09.551165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-672b9037-8a89-48d6-8464-244c40a232b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:09.555145 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-672b9037-8a89-48d6-8464-244c40a232b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:09.557746 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-672b9037-8a89-48d6-8464-244c40a232b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1277 microversion: 2.20 time: 0.174704 Sep 14 01:05:09.558307 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 31/65] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:09 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:09.638101 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-17fdfff8-1826-4bd5-ad4e-c37b253dbe47 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:09.639048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-17fdfff8-1826-4bd5-ad4e-c37b253dbe47 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:09.645683 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-17fdfff8-1826-4bd5-ad4e-c37b253dbe47 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:09.646176 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-17fdfff8-1826-4bd5-ad4e-c37b253dbe47 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:09.646850 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-17fdfff8-1826-4bd5-ad4e-c37b253dbe47 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:09.647683 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-17fdfff8-1826-4bd5-ad4e-c37b253dbe47 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:09.648151 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-17fdfff8-1826-4bd5-ad4e-c37b253dbe47 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:09.648513 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-17fdfff8-1826-4bd5-ad4e-c37b253dbe47 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:09.721035 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-17fdfff8-1826-4bd5-ad4e-c37b253dbe47 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:09.730195 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-17fdfff8-1826-4bd5-ad4e-c37b253dbe47 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1273 microversion: 2.1 time: 0.100599 Sep 14 01:05:09.731093 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 35/66] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:09 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:09.746033 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-5ed1adc8-8617-451e-8a4a-6e71ab4b835a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:09.746806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-5ed1adc8-8617-451e-8a4a-6e71ab4b835a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:09.753301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5ed1adc8-8617-451e-8a4a-6e71ab4b835a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:09.753810 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5ed1adc8-8617-451e-8a4a-6e71ab4b835a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:09.754347 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5ed1adc8-8617-451e-8a4a-6e71ab4b835a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:09.755129 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5ed1adc8-8617-451e-8a4a-6e71ab4b835a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:09.756619 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5ed1adc8-8617-451e-8a4a-6e71ab4b835a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:09.757259 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5ed1adc8-8617-451e-8a4a-6e71ab4b835a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:09.975836 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-5ed1adc8-8617-451e-8a4a-6e71ab4b835a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:09.985561 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-5ed1adc8-8617-451e-8a4a-6e71ab4b835a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 0.243034 Sep 14 01:05:09.985561 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 32/67] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:09 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:10.052005 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ea2a65d1-a4e4-4614-8c85-7fff601c4655 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:10.052776 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ea2a65d1-a4e4-4614-8c85-7fff601c4655 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:10.059746 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ea2a65d1-a4e4-4614-8c85-7fff601c4655 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:10.060518 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ea2a65d1-a4e4-4614-8c85-7fff601c4655 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:10.061239 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ea2a65d1-a4e4-4614-8c85-7fff601c4655 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:10.062351 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ea2a65d1-a4e4-4614-8c85-7fff601c4655 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:10.063010 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ea2a65d1-a4e4-4614-8c85-7fff601c4655 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:10.063671 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ea2a65d1-a4e4-4614-8c85-7fff601c4655 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:10.132451 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ea2a65d1-a4e4-4614-8c85-7fff601c4655 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:10.142560 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ea2a65d1-a4e4-4614-8c85-7fff601c4655 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1233 microversion: 2.1 time: 0.094338 Sep 14 01:05:10.156993 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 36/68] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:10 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1233 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:10.492212 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8f046c74-4888-4225-99c4-a535d64696eb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:10.492949 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8f046c74-4888-4225-99c4-a535d64696eb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:10.513148 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8f046c74-4888-4225-99c4-a535d64696eb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:10.515013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8f046c74-4888-4225-99c4-a535d64696eb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:10.517443 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8f046c74-4888-4225-99c4-a535d64696eb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:10.519422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8f046c74-4888-4225-99c4-a535d64696eb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:10.520459 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8f046c74-4888-4225-99c4-a535d64696eb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:10.523657 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8f046c74-4888-4225-99c4-a535d64696eb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:10.601063 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-aaf8cd4f-22a9-4133-b131-f3abf76f59e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:10.610796 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-aaf8cd4f-22a9-4133-b131-f3abf76f59e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:10.656439 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aaf8cd4f-22a9-4133-b131-f3abf76f59e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:10.658618 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aaf8cd4f-22a9-4133-b131-f3abf76f59e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:10.671134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aaf8cd4f-22a9-4133-b131-f3abf76f59e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:10.675528 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aaf8cd4f-22a9-4133-b131-f3abf76f59e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:10.676606 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aaf8cd4f-22a9-4133-b131-f3abf76f59e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:10.677421 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aaf8cd4f-22a9-4133-b131-f3abf76f59e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:10.807516 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8f046c74-4888-4225-99c4-a535d64696eb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:10.824447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8f046c74-4888-4225-99c4-a535d64696eb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1238 microversion: 2.1 time: 0.348282 Sep 14 01:05:10.833498 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 33/69] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:10 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1238 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:10.864461 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-91831d21-d481-4699-8f40-a19a1e5cd893 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:10.865966 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-91831d21-d481-4699-8f40-a19a1e5cd893 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:10.921871 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-91831d21-d481-4699-8f40-a19a1e5cd893 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:10.930647 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-aaf8cd4f-22a9-4133-b131-f3abf76f59e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:10.952698 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-91831d21-d481-4699-8f40-a19a1e5cd893 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:10.955150 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-91831d21-d481-4699-8f40-a19a1e5cd893 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:10.956446 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-91831d21-d481-4699-8f40-a19a1e5cd893 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:10.963179 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-91831d21-d481-4699-8f40-a19a1e5cd893 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:10.964491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-91831d21-d481-4699-8f40-a19a1e5cd893 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:10.986053 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-aaf8cd4f-22a9-4133-b131-f3abf76f59e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:11.000878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-aaf8cd4f-22a9-4133-b131-f3abf76f59e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:11.009429 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-aaf8cd4f-22a9-4133-b131-f3abf76f59e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1277 microversion: 2.20 time: 0.423381 Sep 14 01:05:11.011235 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 37/70] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:10 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1277 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:05:11.061356 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2234247b-86ea-44b5-bfbf-5abee17f177a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:11.062894 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2234247b-86ea-44b5-bfbf-5abee17f177a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:11.081028 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2234247b-86ea-44b5-bfbf-5abee17f177a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:11.082942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2234247b-86ea-44b5-bfbf-5abee17f177a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:11.085216 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2234247b-86ea-44b5-bfbf-5abee17f177a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:11.087082 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2234247b-86ea-44b5-bfbf-5abee17f177a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:11.089067 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2234247b-86ea-44b5-bfbf-5abee17f177a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:11.089936 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2234247b-86ea-44b5-bfbf-5abee17f177a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:11.567955 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-91831d21-d481-4699-8f40-a19a1e5cd893 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:11.580059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-91831d21-d481-4699-8f40-a19a1e5cd893 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1281 microversion: 2.1 time: 0.744267 Sep 14 01:05:11.610710 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 34/71] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:10 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1281 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:11.624848 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2234247b-86ea-44b5-bfbf-5abee17f177a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:11.634016 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d4320e43-1dd5-463c-bda7-9f92f0ee5ad2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:11.634634 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d4320e43-1dd5-463c-bda7-9f92f0ee5ad2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:11.640556 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2234247b-86ea-44b5-bfbf-5abee17f177a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 0.613731 Sep 14 01:05:11.652624 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 38/72] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:11 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:11.691714 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d4320e43-1dd5-463c-bda7-9f92f0ee5ad2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:11.694633 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d4320e43-1dd5-463c-bda7-9f92f0ee5ad2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:11.695335 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d4320e43-1dd5-463c-bda7-9f92f0ee5ad2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:11.700063 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d4320e43-1dd5-463c-bda7-9f92f0ee5ad2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:11.700494 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d4320e43-1dd5-463c-bda7-9f92f0ee5ad2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:11.700931 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d4320e43-1dd5-463c-bda7-9f92f0ee5ad2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:11.851919 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c6da7a78-5bfd-470c-b4b3-b26eac0e45d5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:11.852551 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c6da7a78-5bfd-470c-b4b3-b26eac0e45d5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:11.857985 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d4320e43-1dd5-463c-bda7-9f92f0ee5ad2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:11.870631 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c6da7a78-5bfd-470c-b4b3-b26eac0e45d5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:11.871212 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d4320e43-1dd5-463c-bda7-9f92f0ee5ad2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1289 microversion: 2.1 time: 0.257756 Sep 14 01:05:11.871829 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 35/73] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:11 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1289 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:11.876020 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c6da7a78-5bfd-470c-b4b3-b26eac0e45d5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:11.876692 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c6da7a78-5bfd-470c-b4b3-b26eac0e45d5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:11.879049 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c6da7a78-5bfd-470c-b4b3-b26eac0e45d5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:11.883270 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c6da7a78-5bfd-470c-b4b3-b26eac0e45d5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:11.885306 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c6da7a78-5bfd-470c-b4b3-b26eac0e45d5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:12.039949 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-67096c9a-f58e-4f0a-a9d4-fce8763288b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:12.040887 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-67096c9a-f58e-4f0a-a9d4-fce8763288b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:12.052091 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-67096c9a-f58e-4f0a-a9d4-fce8763288b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:12.053479 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-67096c9a-f58e-4f0a-a9d4-fce8763288b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:12.055240 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-67096c9a-f58e-4f0a-a9d4-fce8763288b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:12.057636 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-67096c9a-f58e-4f0a-a9d4-fce8763288b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:12.058306 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-67096c9a-f58e-4f0a-a9d4-fce8763288b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:12.059376 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-67096c9a-f58e-4f0a-a9d4-fce8763288b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:12.204246 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c6da7a78-5bfd-470c-b4b3-b26eac0e45d5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:12.207905 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:12.229991 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c6da7a78-5bfd-470c-b4b3-b26eac0e45d5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1238 microversion: 2.1 time: 0.381022 Sep 14 01:05:12.235261 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 39/74] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:11 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1238 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:12.610983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fd9e747f-4b14-4c3b-8429-50e0cf3fafe2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:12.612163 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fd9e747f-4b14-4c3b-8429-50e0cf3fafe2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:12.630802 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fd9e747f-4b14-4c3b-8429-50e0cf3fafe2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:12.632552 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fd9e747f-4b14-4c3b-8429-50e0cf3fafe2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:12.633787 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fd9e747f-4b14-4c3b-8429-50e0cf3fafe2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:12.637320 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fd9e747f-4b14-4c3b-8429-50e0cf3fafe2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:12.639995 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fd9e747f-4b14-4c3b-8429-50e0cf3fafe2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:12.643938 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fd9e747f-4b14-4c3b-8429-50e0cf3fafe2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:12.686249 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-67096c9a-f58e-4f0a-a9d4-fce8763288b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:12.696154 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-67096c9a-f58e-4f0a-a9d4-fce8763288b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:12.697614 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-67096c9a-f58e-4f0a-a9d4-fce8763288b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:12.698730 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-67096c9a-f58e-4f0a-a9d4-fce8763288b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1277 microversion: 2.20 time: 0.663695 Sep 14 01:05:12.718726 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=4 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:12.721397 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 36/75] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:12 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1277 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:05:12.726860 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-fbb840c8-595c-4d8c-b87c-74b7a936747f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:12.770526 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-fbb840c8-595c-4d8c-b87c-74b7a936747f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:12.802105 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fbb840c8-595c-4d8c-b87c-74b7a936747f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:12.802734 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fbb840c8-595c-4d8c-b87c-74b7a936747f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:12.802734 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fbb840c8-595c-4d8c-b87c-74b7a936747f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:12.804498 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fbb840c8-595c-4d8c-b87c-74b7a936747f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:12.804942 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fbb840c8-595c-4d8c-b87c-74b7a936747f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:12.805366 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fbb840c8-595c-4d8c-b87c-74b7a936747f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:13.368319 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fd9e747f-4b14-4c3b-8429-50e0cf3fafe2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:13.382451 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fd9e747f-4b14-4c3b-8429-50e0cf3fafe2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1279 microversion: 2.1 time: 0.775443 Sep 14 01:05:13.387088 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 40/76] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:12 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1279 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:13.417523 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2ab7aecc-eb72-4495-b91b-87756cbe0122 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:13.421030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2ab7aecc-eb72-4495-b91b-87756cbe0122 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:13.452186 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2ab7aecc-eb72-4495-b91b-87756cbe0122 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:13.452684 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2ab7aecc-eb72-4495-b91b-87756cbe0122 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:13.453122 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2ab7aecc-eb72-4495-b91b-87756cbe0122 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:13.453830 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2ab7aecc-eb72-4495-b91b-87756cbe0122 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:13.454287 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2ab7aecc-eb72-4495-b91b-87756cbe0122 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:13.476045 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2ab7aecc-eb72-4495-b91b-87756cbe0122 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:13.506755 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=22 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:14.172669 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2ab7aecc-eb72-4495-b91b-87756cbe0122 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:14.183233 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2ab7aecc-eb72-4495-b91b-87756cbe0122 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1307 microversion: 2.1 time: 0.794713 Sep 14 01:05:14.189639 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 41/77] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:13 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1307 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:14.197471 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f3957093-df63-4f57-be41-863dfc12d709 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:14.198466 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f3957093-df63-4f57-be41-863dfc12d709 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:14.211042 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f3957093-df63-4f57-be41-863dfc12d709 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:14.211937 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f3957093-df63-4f57-be41-863dfc12d709 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:14.212600 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f3957093-df63-4f57-be41-863dfc12d709 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:14.218456 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f3957093-df63-4f57-be41-863dfc12d709 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:14.219720 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f3957093-df63-4f57-be41-863dfc12d709 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:14.221124 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f3957093-df63-4f57-be41-863dfc12d709 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:14.708864 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-fbb840c8-595c-4d8c-b87c-74b7a936747f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:14.719922 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-fbb840c8-595c-4d8c-b87c-74b7a936747f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 1.997263 Sep 14 01:05:14.720412 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 37/78] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:12 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 1998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:14.733149 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9f54e113-9447-46e0-a088-0c135b78e599 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:14.733762 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9f54e113-9447-46e0-a088-0c135b78e599 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:14.763846 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9f54e113-9447-46e0-a088-0c135b78e599 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:14.765991 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9f54e113-9447-46e0-a088-0c135b78e599 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:14.768414 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9f54e113-9447-46e0-a088-0c135b78e599 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:14.774328 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9f54e113-9447-46e0-a088-0c135b78e599 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:14.792397 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9f54e113-9447-46e0-a088-0c135b78e599 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:14.793246 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9f54e113-9447-46e0-a088-0c135b78e599 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:14.884649 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f3957093-df63-4f57-be41-863dfc12d709 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:14.921397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f3957093-df63-4f57-be41-863dfc12d709 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1302 microversion: 2.1 time: 0.729375 Sep 14 01:05:14.936544 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 42/79] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:14 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1302 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:14.951820 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-14511c5f-af60-4b26-9daa-38996d32533b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:14.955055 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9f54e113-9447-46e0-a088-0c135b78e599 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:14.959325 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-14511c5f-af60-4b26-9daa-38996d32533b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:14.969413 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9f54e113-9447-46e0-a088-0c135b78e599 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:14.971157 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9f54e113-9447-46e0-a088-0c135b78e599 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:14.975913 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9f54e113-9447-46e0-a088-0c135b78e599 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1333 microversion: 2.20 time: 0.252292 Sep 14 01:05:14.977531 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 38/80] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:14 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1333 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:14.979876 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-14511c5f-af60-4b26-9daa-38996d32533b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:14.980377 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-14511c5f-af60-4b26-9daa-38996d32533b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:14.980816 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-14511c5f-af60-4b26-9daa-38996d32533b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:14.981524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-14511c5f-af60-4b26-9daa-38996d32533b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:14.981986 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-14511c5f-af60-4b26-9daa-38996d32533b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:14.982416 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-14511c5f-af60-4b26-9daa-38996d32533b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:15.228643 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2cab4e1d-cf5a-420a-8751-1710660432c1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:15.229247 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2cab4e1d-cf5a-420a-8751-1710660432c1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:15.232316 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=8 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:15.243618 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2cab4e1d-cf5a-420a-8751-1710660432c1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:15.244385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2cab4e1d-cf5a-420a-8751-1710660432c1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:15.244990 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2cab4e1d-cf5a-420a-8751-1710660432c1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:15.246591 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2cab4e1d-cf5a-420a-8751-1710660432c1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:15.256006 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2cab4e1d-cf5a-420a-8751-1710660432c1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:15.256828 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2cab4e1d-cf5a-420a-8751-1710660432c1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:15.269151 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=100 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:15.430447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-2cab4e1d-cf5a-420a-8751-1710660432c1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:15.447846 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2cab4e1d-cf5a-420a-8751-1710660432c1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1295 microversion: 2.1 time: 0.222352 Sep 14 01:05:15.452164 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 39/81] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:15 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1295 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:15.538049 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-14511c5f-af60-4b26-9daa-38996d32533b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:15.549354 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-14511c5f-af60-4b26-9daa-38996d32533b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1279 microversion: 2.1 time: 0.611311 Sep 14 01:05:15.553644 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 43/82] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:14 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1279 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:15.765363 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-c465c5a1-fd13-4f22-9a32-4697e42627c1 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:15.768762 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-c465c5a1-fd13-4f22-9a32-4697e42627c1 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:15.783198 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=42 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:15.785964 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c465c5a1-fd13-4f22-9a32-4697e42627c1 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:15.788128 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c465c5a1-fd13-4f22-9a32-4697e42627c1 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:15.789656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c465c5a1-fd13-4f22-9a32-4697e42627c1 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:15.790765 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c465c5a1-fd13-4f22-9a32-4697e42627c1 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:15.791597 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c465c5a1-fd13-4f22-9a32-4697e42627c1 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:15.792463 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c465c5a1-fd13-4f22-9a32-4697e42627c1 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:15.961903 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ad2d3b26-99c9-4e38-b552-5cfd49749bc1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:15.962380 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ad2d3b26-99c9-4e38-b552-5cfd49749bc1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:15.972883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ad2d3b26-99c9-4e38-b552-5cfd49749bc1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:15.979118 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ad2d3b26-99c9-4e38-b552-5cfd49749bc1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:15.979890 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ad2d3b26-99c9-4e38-b552-5cfd49749bc1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:15.983880 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ad2d3b26-99c9-4e38-b552-5cfd49749bc1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:15.991987 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ad2d3b26-99c9-4e38-b552-5cfd49749bc1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:15.992814 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ad2d3b26-99c9-4e38-b552-5cfd49749bc1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:16.346795 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ad2d3b26-99c9-4e38-b552-5cfd49749bc1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:16.361254 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ad2d3b26-99c9-4e38-b552-5cfd49749bc1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1300 microversion: 2.1 time: 0.404216 Sep 14 01:05:16.394134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 44/83] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:15 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1300 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:16.433721 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1a79bc27-5fc5-4461-81c9-763a5ce851cd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:16.436507 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1a79bc27-5fc5-4461-81c9-763a5ce851cd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:16.451576 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:16.454556 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1a79bc27-5fc5-4461-81c9-763a5ce851cd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:16.497145 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1a79bc27-5fc5-4461-81c9-763a5ce851cd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:16.499529 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1a79bc27-5fc5-4461-81c9-763a5ce851cd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:16.500480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1a79bc27-5fc5-4461-81c9-763a5ce851cd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:16.501316 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1a79bc27-5fc5-4461-81c9-763a5ce851cd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:16.504252 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1a79bc27-5fc5-4461-81c9-763a5ce851cd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:16.609602 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c465c5a1-fd13-4f22-9a32-4697e42627c1 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:16.621061 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-c465c5a1-fd13-4f22-9a32-4697e42627c1 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 0.867644 Sep 14 01:05:16.621735 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 40/84] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:15 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:16.627271 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-108c6595-5439-4a0d-8594-2b6ab33ad616 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:16.628496 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-108c6595-5439-4a0d-8594-2b6ab33ad616 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:16.635423 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-108c6595-5439-4a0d-8594-2b6ab33ad616 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:16.658866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-108c6595-5439-4a0d-8594-2b6ab33ad616 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:16.660606 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-108c6595-5439-4a0d-8594-2b6ab33ad616 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:16.664394 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-108c6595-5439-4a0d-8594-2b6ab33ad616 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:16.667274 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-108c6595-5439-4a0d-8594-2b6ab33ad616 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:16.668393 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-108c6595-5439-4a0d-8594-2b6ab33ad616 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:16.738827 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1a79bc27-5fc5-4461-81c9-763a5ce851cd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:16.752152 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1a79bc27-5fc5-4461-81c9-763a5ce851cd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:16.759341 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1a79bc27-5fc5-4461-81c9-763a5ce851cd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:16.761943 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1a79bc27-5fc5-4461-81c9-763a5ce851cd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1339 microversion: 2.20 time: 0.365638 Sep 14 01:05:16.789410 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 45/85] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:16 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1339 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:16.816766 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-60b9cc53-13e2-479b-9a14-ec7935ccc83f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:16.817476 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-60b9cc53-13e2-479b-9a14-ec7935ccc83f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:16.833699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-60b9cc53-13e2-479b-9a14-ec7935ccc83f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:16.834778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-60b9cc53-13e2-479b-9a14-ec7935ccc83f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:16.835542 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-60b9cc53-13e2-479b-9a14-ec7935ccc83f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:16.839367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-60b9cc53-13e2-479b-9a14-ec7935ccc83f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:16.839367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-60b9cc53-13e2-479b-9a14-ec7935ccc83f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:16.839367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-60b9cc53-13e2-479b-9a14-ec7935ccc83f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:18.122933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-108c6595-5439-4a0d-8594-2b6ab33ad616 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:18.143445 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-108c6595-5439-4a0d-8594-2b6ab33ad616 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1295 microversion: 2.1 time: 1.520055 Sep 14 01:05:18.144708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 41/86] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:16 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1295 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:18.165211 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2e1b0d3e-ef53-4ef6-ae71-521c77794646 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:18.168010 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2e1b0d3e-ef53-4ef6-ae71-521c77794646 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:18.183478 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2e1b0d3e-ef53-4ef6-ae71-521c77794646 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:18.228399 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2e1b0d3e-ef53-4ef6-ae71-521c77794646 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:18.229120 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2e1b0d3e-ef53-4ef6-ae71-521c77794646 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.044s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:18.231224 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2e1b0d3e-ef53-4ef6-ae71-521c77794646 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:18.232202 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2e1b0d3e-ef53-4ef6-ae71-521c77794646 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:18.233083 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2e1b0d3e-ef53-4ef6-ae71-521c77794646 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:18.534775 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-2e1b0d3e-ef53-4ef6-ae71-521c77794646 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:18.546407 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2e1b0d3e-ef53-4ef6-ae71-521c77794646 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1300 microversion: 2.1 time: 0.400102 Sep 14 01:05:18.562406 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 42/87] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:18 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1300 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:18.583314 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0b3a2489-ed74-4e67-8972-cdeb54644595 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:18.584362 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0b3a2489-ed74-4e67-8972-cdeb54644595 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:18.588200 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-60b9cc53-13e2-479b-9a14-ec7935ccc83f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:18.595602 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0b3a2489-ed74-4e67-8972-cdeb54644595 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:18.596490 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0b3a2489-ed74-4e67-8972-cdeb54644595 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:18.598245 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0b3a2489-ed74-4e67-8972-cdeb54644595 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:18.600357 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0b3a2489-ed74-4e67-8972-cdeb54644595 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:18.609882 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-60b9cc53-13e2-479b-9a14-ec7935ccc83f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1321 microversion: 2.1 time: 1.818626 Sep 14 01:05:18.610886 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 46/88] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:16 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1321 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:18.619069 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0b3a2489-ed74-4e67-8972-cdeb54644595 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:18.621191 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-bc2bd842-4835-41a8-ad1d-79d24baecf85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:18.622071 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0b3a2489-ed74-4e67-8972-cdeb54644595 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:18.623157 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-bc2bd842-4835-41a8-ad1d-79d24baecf85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:18.638894 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bc2bd842-4835-41a8-ad1d-79d24baecf85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:18.640595 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bc2bd842-4835-41a8-ad1d-79d24baecf85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:18.641558 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bc2bd842-4835-41a8-ad1d-79d24baecf85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:18.642498 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bc2bd842-4835-41a8-ad1d-79d24baecf85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:18.643710 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bc2bd842-4835-41a8-ad1d-79d24baecf85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:18.644544 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bc2bd842-4835-41a8-ad1d-79d24baecf85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:19.133834 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-bc2bd842-4835-41a8-ad1d-79d24baecf85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:19.150097 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-bc2bd842-4835-41a8-ad1d-79d24baecf85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:19.155770 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-bc2bd842-4835-41a8-ad1d-79d24baecf85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:19.159816 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-bc2bd842-4835-41a8-ad1d-79d24baecf85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1339 microversion: 2.20 time: 0.545052 Sep 14 01:05:19.160692 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 47/89] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:18 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1339 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:19.316474 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-3e2d1e0a-6d22-4f7f-b5e4-f2b086d096e2 req-38107c6c-a5f6-4ed7-838e-e1c2b4b54c61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96664d10-3eeb-4172-b866-7d824c2310d3", "tag": "dd7f3405-9f9e-4062-a010-7d8bae1bc828"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:19.357390 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-3e2d1e0a-6d22-4f7f-b5e4-f2b086d096e2 req-38107c6c-a5f6-4ed7-838e-e1c2b4b54c61 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:19.360244 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-3e2d1e0a-6d22-4f7f-b5e4-f2b086d096e2 req-38107c6c-a5f6-4ed7-838e-e1c2b4b54c61 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:19.361055 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-3e2d1e0a-6d22-4f7f-b5e4-f2b086d096e2 req-38107c6c-a5f6-4ed7-838e-e1c2b4b54c61 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:19.406238 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-3e2d1e0a-6d22-4f7f-b5e4-f2b086d096e2 req-38107c6c-a5f6-4ed7-838e-e1c2b4b54c61 service nova] Creating event network-changed:dd7f3405-9f9e-4062-a010-7d8bae1bc828 for instance 96664d10-3eeb-4172-b866-7d824c2310d3 on hv-cinder-85752 Sep 14 01:05:19.409142 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-3e2d1e0a-6d22-4f7f-b5e4-f2b086d096e2 req-38107c6c-a5f6-4ed7-838e-e1c2b4b54c61 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120621) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 01:05:19.411614 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-3e2d1e0a-6d22-4f7f-b5e4-f2b086d096e2 req-38107c6c-a5f6-4ed7-838e-e1c2b4b54c61 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120621) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 01:05:19.413298 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84774c11-83b0-43a1-a5c5-e0d0c9f218c6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:19.413772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84774c11-83b0-43a1-a5c5-e0d0c9f218c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:19.414207 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84774c11-83b0-43a1-a5c5-e0d0c9f218c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:19.414925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84774c11-83b0-43a1-a5c5-e0d0c9f218c6 None None] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:19.415380 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84774c11-83b0-43a1-a5c5-e0d0c9f218c6 None None] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:19.415867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84774c11-83b0-43a1-a5c5-e0d0c9f218c6 None None] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:19.436506 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.compute.rpcapi [None req-84774c11-83b0-43a1-a5c5-e0d0c9f218c6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 14 01:05:19.441057 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84774c11-83b0-43a1-a5c5-e0d0c9f218c6 None None] Releasing lock "compute-rpcapi-router" {{(pid=120621) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 01:05:19.472237 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-84774c11-83b0-43a1-a5c5-e0d0c9f218c6 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.307666 Sep 14 01:05:19.473133 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 48/90] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:05:19.488386 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-58b2f749-9e69-456d-8e0e-828e9b02ac01 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:19.492810 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-58b2f749-9e69-456d-8e0e-828e9b02ac01 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:19.510057 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58b2f749-9e69-456d-8e0e-828e9b02ac01 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:19.510577 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58b2f749-9e69-456d-8e0e-828e9b02ac01 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:19.511013 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58b2f749-9e69-456d-8e0e-828e9b02ac01 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:19.523357 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58b2f749-9e69-456d-8e0e-828e9b02ac01 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:19.524275 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58b2f749-9e69-456d-8e0e-828e9b02ac01 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:19.525009 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58b2f749-9e69-456d-8e0e-828e9b02ac01 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:19.741965 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-58b2f749-9e69-456d-8e0e-828e9b02ac01 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:19.758777 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-58b2f749-9e69-456d-8e0e-828e9b02ac01 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1295 microversion: 2.1 time: 0.282914 Sep 14 01:05:19.761689 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 49/91] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:19 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1295 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:19.775045 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8c355e86-f07d-4d51-9286-dd917b1b7422 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:19.776374 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8c355e86-f07d-4d51-9286-dd917b1b7422 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:19.785555 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8c355e86-f07d-4d51-9286-dd917b1b7422 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:19.786657 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8c355e86-f07d-4d51-9286-dd917b1b7422 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:19.788396 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8c355e86-f07d-4d51-9286-dd917b1b7422 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:19.789788 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8c355e86-f07d-4d51-9286-dd917b1b7422 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:19.790722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8c355e86-f07d-4d51-9286-dd917b1b7422 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:19.791679 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8c355e86-f07d-4d51-9286-dd917b1b7422 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:20.188183 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8c355e86-f07d-4d51-9286-dd917b1b7422 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:20.206311 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8c355e86-f07d-4d51-9286-dd917b1b7422 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1368 microversion: 2.1 time: 0.438138 Sep 14 01:05:20.223315 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 50/92] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:19 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1368 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:20.267284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-71f3a9e1-6e98-4a98-97cb-8950b9c23eaa tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:20.268354 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-71f3a9e1-6e98-4a98-97cb-8950b9c23eaa tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:20.278196 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-71f3a9e1-6e98-4a98-97cb-8950b9c23eaa tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:20.278732 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-71f3a9e1-6e98-4a98-97cb-8950b9c23eaa tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:20.279164 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-71f3a9e1-6e98-4a98-97cb-8950b9c23eaa tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:20.280541 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-71f3a9e1-6e98-4a98-97cb-8950b9c23eaa tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:20.282302 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-71f3a9e1-6e98-4a98-97cb-8950b9c23eaa tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:20.282740 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-71f3a9e1-6e98-4a98-97cb-8950b9c23eaa tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:20.516912 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0b3a2489-ed74-4e67-8972-cdeb54644595 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:20.545440 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0b3a2489-ed74-4e67-8972-cdeb54644595 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 1.979129 Sep 14 01:05:20.551264 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 43/93] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:18 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 1988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:20.573390 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-cebfc162-8913-48fe-b5e7-43c0be5bd616 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:20.573998 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-cebfc162-8913-48fe-b5e7-43c0be5bd616 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:20.624766 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cebfc162-8913-48fe-b5e7-43c0be5bd616 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:20.626974 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cebfc162-8913-48fe-b5e7-43c0be5bd616 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:20.628787 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cebfc162-8913-48fe-b5e7-43c0be5bd616 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:20.631859 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cebfc162-8913-48fe-b5e7-43c0be5bd616 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:20.633854 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cebfc162-8913-48fe-b5e7-43c0be5bd616 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:20.635195 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cebfc162-8913-48fe-b5e7-43c0be5bd616 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:20.928357 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-71f3a9e1-6e98-4a98-97cb-8950b9c23eaa tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:20.948317 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-71f3a9e1-6e98-4a98-97cb-8950b9c23eaa tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1321 microversion: 2.1 time: 0.718316 Sep 14 01:05:20.949615 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 51/94] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:20 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1321 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:20.960096 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c1e2034b-ed4b-44f1-8d0d-4a4d5190bbb1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:20.962932 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c1e2034b-ed4b-44f1-8d0d-4a4d5190bbb1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:20.976446 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c1e2034b-ed4b-44f1-8d0d-4a4d5190bbb1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:20.977883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c1e2034b-ed4b-44f1-8d0d-4a4d5190bbb1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:20.979723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c1e2034b-ed4b-44f1-8d0d-4a4d5190bbb1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:20.981233 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c1e2034b-ed4b-44f1-8d0d-4a4d5190bbb1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:20.982437 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c1e2034b-ed4b-44f1-8d0d-4a4d5190bbb1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:20.984123 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c1e2034b-ed4b-44f1-8d0d-4a4d5190bbb1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:21.322225 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-cebfc162-8913-48fe-b5e7-43c0be5bd616 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:21.345105 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-cebfc162-8913-48fe-b5e7-43c0be5bd616 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:21.351005 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-cebfc162-8913-48fe-b5e7-43c0be5bd616 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:21.361119 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-cebfc162-8913-48fe-b5e7-43c0be5bd616 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1339 microversion: 2.20 time: 0.799922 Sep 14 01:05:21.361842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 44/95] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:20 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1339 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:21.380697 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-eec542d5-4782-4d6d-9a00-40d43eb1aac3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:21.381574 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-eec542d5-4782-4d6d-9a00-40d43eb1aac3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:21.392921 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eec542d5-4782-4d6d-9a00-40d43eb1aac3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:21.393945 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eec542d5-4782-4d6d-9a00-40d43eb1aac3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:21.394554 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eec542d5-4782-4d6d-9a00-40d43eb1aac3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:21.395437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eec542d5-4782-4d6d-9a00-40d43eb1aac3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:21.396813 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eec542d5-4782-4d6d-9a00-40d43eb1aac3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:21.398601 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eec542d5-4782-4d6d-9a00-40d43eb1aac3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:21.572499 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c1e2034b-ed4b-44f1-8d0d-4a4d5190bbb1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:21.588488 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c1e2034b-ed4b-44f1-8d0d-4a4d5190bbb1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1295 microversion: 2.1 time: 0.636127 Sep 14 01:05:21.616212 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 52/96] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:20 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1295 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:21.838658 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-3254bc47-f38c-4f4a-b3dd-8cf187718b68 req-894ba4f3-32df-44ff-b969-f0f8cd72537f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa", "tag": "0f1f31eb-05bc-4b3d-995e-4fba37dfe847"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:21.869257 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-3254bc47-f38c-4f4a-b3dd-8cf187718b68 req-894ba4f3-32df-44ff-b969-f0f8cd72537f service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:21.871354 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-3254bc47-f38c-4f4a-b3dd-8cf187718b68 req-894ba4f3-32df-44ff-b969-f0f8cd72537f service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:21.871910 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-3254bc47-f38c-4f4a-b3dd-8cf187718b68 req-894ba4f3-32df-44ff-b969-f0f8cd72537f service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:21.896143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-3254bc47-f38c-4f4a-b3dd-8cf187718b68 req-894ba4f3-32df-44ff-b969-f0f8cd72537f service nova] Creating event network-changed:0f1f31eb-05bc-4b3d-995e-4fba37dfe847 for instance 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa on hv-cinder-85752 Sep 14 01:05:21.912643 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-3254bc47-f38c-4f4a-b3dd-8cf187718b68 req-894ba4f3-32df-44ff-b969-f0f8cd72537f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295000 Sep 14 01:05:21.915243 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 53/97] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:05:21.923992 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-a4775f65-cf14-44df-82ad-485fcbb120e4 req-e22d004d-d465-4062-8b57-ecbec690ae43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449d7479-aa1a-475f-baf9-ecee9f4a52f4", "tag": "9bbe2be7-ebc9-44fb-b5fb-4efec8957ccb"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:21.954451 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-a4775f65-cf14-44df-82ad-485fcbb120e4 req-e22d004d-d465-4062-8b57-ecbec690ae43 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:21.955125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-a4775f65-cf14-44df-82ad-485fcbb120e4 req-e22d004d-d465-4062-8b57-ecbec690ae43 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:21.956020 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-a4775f65-cf14-44df-82ad-485fcbb120e4 req-e22d004d-d465-4062-8b57-ecbec690ae43 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:21.987289 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-a4775f65-cf14-44df-82ad-485fcbb120e4 req-e22d004d-d465-4062-8b57-ecbec690ae43 service nova] Creating event network-changed:9bbe2be7-ebc9-44fb-b5fb-4efec8957ccb for instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 on hv-cinder-85752 Sep 14 01:05:22.001053 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-a4775f65-cf14-44df-82ad-485fcbb120e4 req-e22d004d-d465-4062-8b57-ecbec690ae43 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084258 Sep 14 01:05:22.004636 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 54/98] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:05:22.020076 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8687be14-71e4-473e-a675-a9c0473d19cd tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:22.022825 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8687be14-71e4-473e-a675-a9c0473d19cd tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:22.026733 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-eec542d5-4782-4d6d-9a00-40d43eb1aac3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:22.040406 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8687be14-71e4-473e-a675-a9c0473d19cd tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:22.040945 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8687be14-71e4-473e-a675-a9c0473d19cd tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:22.043199 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8687be14-71e4-473e-a675-a9c0473d19cd tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:22.043955 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8687be14-71e4-473e-a675-a9c0473d19cd tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:22.045663 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8687be14-71e4-473e-a675-a9c0473d19cd tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:22.048268 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8687be14-71e4-473e-a675-a9c0473d19cd tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:22.058270 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-eec542d5-4782-4d6d-9a00-40d43eb1aac3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1368 microversion: 2.1 time: 0.685439 Sep 14 01:05:22.059036 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 45/99] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:21 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1368 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:22.065330 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d363b6ca-c4c3-486d-b3fd-bb09f539180c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:22.069005 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d363b6ca-c4c3-486d-b3fd-bb09f539180c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:22.094749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d363b6ca-c4c3-486d-b3fd-bb09f539180c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:22.096320 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d363b6ca-c4c3-486d-b3fd-bb09f539180c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:22.101121 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d363b6ca-c4c3-486d-b3fd-bb09f539180c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:22.102184 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d363b6ca-c4c3-486d-b3fd-bb09f539180c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:22.102963 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d363b6ca-c4c3-486d-b3fd-bb09f539180c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:22.113953 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d363b6ca-c4c3-486d-b3fd-bb09f539180c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:22.864384 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d363b6ca-c4c3-486d-b3fd-bb09f539180c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:22.877481 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d363b6ca-c4c3-486d-b3fd-bb09f539180c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1321 microversion: 2.1 time: 0.816365 Sep 14 01:05:22.885506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 46/100] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:22 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1321 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:22.897326 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8687be14-71e4-473e-a675-a9c0473d19cd tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:22.897878 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a5d4f96d-ad3a-470d-a999-0af4a547cffe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:22.898670 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a5d4f96d-ad3a-470d-a999-0af4a547cffe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:22.907787 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a5d4f96d-ad3a-470d-a999-0af4a547cffe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:22.908464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a5d4f96d-ad3a-470d-a999-0af4a547cffe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:22.909053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a5d4f96d-ad3a-470d-a999-0af4a547cffe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:22.910699 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a5d4f96d-ad3a-470d-a999-0af4a547cffe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:22.911362 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a5d4f96d-ad3a-470d-a999-0af4a547cffe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:22.912255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a5d4f96d-ad3a-470d-a999-0af4a547cffe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:22.918842 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8687be14-71e4-473e-a675-a9c0473d19cd tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 0.911384 Sep 14 01:05:22.921077 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 55/101] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:22 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:22.925801 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-746c6db5-3d8d-4f6b-8b60-72815f7beabd tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:22.926416 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-746c6db5-3d8d-4f6b-8b60-72815f7beabd tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:22.932655 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-746c6db5-3d8d-4f6b-8b60-72815f7beabd tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:22.933148 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-746c6db5-3d8d-4f6b-8b60-72815f7beabd tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:22.933589 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-746c6db5-3d8d-4f6b-8b60-72815f7beabd tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:22.944329 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-746c6db5-3d8d-4f6b-8b60-72815f7beabd tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:22.952455 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-746c6db5-3d8d-4f6b-8b60-72815f7beabd tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:22.953152 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-746c6db5-3d8d-4f6b-8b60-72815f7beabd tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:23.176904 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a5d4f96d-ad3a-470d-a999-0af4a547cffe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:23.207807 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a5d4f96d-ad3a-470d-a999-0af4a547cffe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:23.211349 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a5d4f96d-ad3a-470d-a999-0af4a547cffe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:23.218044 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a5d4f96d-ad3a-470d-a999-0af4a547cffe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1406 microversion: 2.20 time: 0.330497 Sep 14 01:05:23.221458 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 47/102] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:22 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1406 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:23.224617 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-746c6db5-3d8d-4f6b-8b60-72815f7beabd tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:23.229116 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d1dda53a-c726-4645-9298-b25a60142bd6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:23.229752 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d1dda53a-c726-4645-9298-b25a60142bd6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:23.234764 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-746c6db5-3d8d-4f6b-8b60-72815f7beabd tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.312645 Sep 14 01:05:23.235846 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 56/103] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:22 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:23.249703 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d1dda53a-c726-4645-9298-b25a60142bd6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:23.250196 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d1dda53a-c726-4645-9298-b25a60142bd6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:23.250626 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d1dda53a-c726-4645-9298-b25a60142bd6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:23.251398 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d1dda53a-c726-4645-9298-b25a60142bd6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:23.251903 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d1dda53a-c726-4645-9298-b25a60142bd6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:23.256205 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d1dda53a-c726-4645-9298-b25a60142bd6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:23.442635 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d1dda53a-c726-4645-9298-b25a60142bd6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:23.451357 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d1dda53a-c726-4645-9298-b25a60142bd6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1368 microversion: 2.1 time: 0.228606 Sep 14 01:05:23.451974 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 48/104] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:23 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:23.901646 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-cbe11256-1264-4af2-885f-5196b9a1aeb1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:23.902260 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-cbe11256-1264-4af2-885f-5196b9a1aeb1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:23.908188 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cbe11256-1264-4af2-885f-5196b9a1aeb1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:23.908684 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cbe11256-1264-4af2-885f-5196b9a1aeb1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:23.909100 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cbe11256-1264-4af2-885f-5196b9a1aeb1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:23.909998 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cbe11256-1264-4af2-885f-5196b9a1aeb1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:23.910670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cbe11256-1264-4af2-885f-5196b9a1aeb1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:23.911163 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cbe11256-1264-4af2-885f-5196b9a1aeb1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:23.949756 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-72091840-ebc9-42db-b0c6-61e9bab3c88f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:23.950818 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-72091840-ebc9-42db-b0c6-61e9bab3c88f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:23.960353 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-72091840-ebc9-42db-b0c6-61e9bab3c88f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:23.960940 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-72091840-ebc9-42db-b0c6-61e9bab3c88f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:23.961576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-72091840-ebc9-42db-b0c6-61e9bab3c88f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:23.963108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-72091840-ebc9-42db-b0c6-61e9bab3c88f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:23.964457 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-72091840-ebc9-42db-b0c6-61e9bab3c88f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:23.965502 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-72091840-ebc9-42db-b0c6-61e9bab3c88f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:24.092792 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cbe11256-1264-4af2-885f-5196b9a1aeb1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:24.102978 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-cbe11256-1264-4af2-885f-5196b9a1aeb1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1321 microversion: 2.1 time: 0.205063 Sep 14 01:05:24.104247 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 57/105] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:23 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:24.109525 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-dec6f5c2-4382-425e-b0f6-6565ccfd3beb req-a5e3e01d-a5ce-404a-8113-64f5d18ee68f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f390b4d1-983e-4ea4-bb3f-e7e7e82a564a", "tag": "c55b96cb-5290-47cc-a378-c5a31536d115"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:24.120848 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-dec6f5c2-4382-425e-b0f6-6565ccfd3beb req-a5e3e01d-a5ce-404a-8113-64f5d18ee68f service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:24.121957 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-dec6f5c2-4382-425e-b0f6-6565ccfd3beb req-a5e3e01d-a5ce-404a-8113-64f5d18ee68f service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:24.122582 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-dec6f5c2-4382-425e-b0f6-6565ccfd3beb req-a5e3e01d-a5ce-404a-8113-64f5d18ee68f service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:24.141902 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:24.168342 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-dec6f5c2-4382-425e-b0f6-6565ccfd3beb req-a5e3e01d-a5ce-404a-8113-64f5d18ee68f service nova] Creating event network-changed:c55b96cb-5290-47cc-a378-c5a31536d115 for instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a on hv-cinder-85752 Sep 14 01:05:24.189553 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-dec6f5c2-4382-425e-b0f6-6565ccfd3beb req-a5e3e01d-a5ce-404a-8113-64f5d18ee68f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083194 Sep 14 01:05:24.190656 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 58/106] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:05:24.248854 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6fb0252e-b9be-4fb5-943e-bfc73b8412ec tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:24.249533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6fb0252e-b9be-4fb5-943e-bfc73b8412ec tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:24.266310 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6fb0252e-b9be-4fb5-943e-bfc73b8412ec tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:24.266814 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6fb0252e-b9be-4fb5-943e-bfc73b8412ec tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:24.267250 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6fb0252e-b9be-4fb5-943e-bfc73b8412ec tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:24.267981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6fb0252e-b9be-4fb5-943e-bfc73b8412ec tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:24.268437 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6fb0252e-b9be-4fb5-943e-bfc73b8412ec tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:24.268857 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6fb0252e-b9be-4fb5-943e-bfc73b8412ec tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:24.773149 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-72091840-ebc9-42db-b0c6-61e9bab3c88f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:24.781865 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-72091840-ebc9-42db-b0c6-61e9bab3c88f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 0.843831 Sep 14 01:05:24.783842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 49/107] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:23 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:24.795833 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4f12d4f6-92e1-48cb-8afb-255554ba4197 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:24.796986 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4f12d4f6-92e1-48cb-8afb-255554ba4197 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:24.809183 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4f12d4f6-92e1-48cb-8afb-255554ba4197 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:24.811927 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4f12d4f6-92e1-48cb-8afb-255554ba4197 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:24.812391 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4f12d4f6-92e1-48cb-8afb-255554ba4197 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:24.813892 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4f12d4f6-92e1-48cb-8afb-255554ba4197 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:24.817510 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4f12d4f6-92e1-48cb-8afb-255554ba4197 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:24.818093 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4f12d4f6-92e1-48cb-8afb-255554ba4197 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:24.988797 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6fb0252e-b9be-4fb5-943e-bfc73b8412ec tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:25.002538 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6fb0252e-b9be-4fb5-943e-bfc73b8412ec tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:25.004079 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6fb0252e-b9be-4fb5-943e-bfc73b8412ec tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:25.005233 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6fb0252e-b9be-4fb5-943e-bfc73b8412ec tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1406 microversion: 2.20 time: 0.762943 Sep 14 01:05:25.005999 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 59/108] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:24 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1406 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:05:25.023774 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-df9d231f-1088-4a56-a6d9-9f2ecdd3da7b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:25.028093 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-df9d231f-1088-4a56-a6d9-9f2ecdd3da7b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:25.034658 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df9d231f-1088-4a56-a6d9-9f2ecdd3da7b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:25.035296 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df9d231f-1088-4a56-a6d9-9f2ecdd3da7b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:25.035934 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df9d231f-1088-4a56-a6d9-9f2ecdd3da7b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:25.037324 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df9d231f-1088-4a56-a6d9-9f2ecdd3da7b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:25.038298 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df9d231f-1088-4a56-a6d9-9f2ecdd3da7b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:25.038884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df9d231f-1088-4a56-a6d9-9f2ecdd3da7b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:25.341253 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4f12d4f6-92e1-48cb-8afb-255554ba4197 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:25.352470 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4f12d4f6-92e1-48cb-8afb-255554ba4197 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.567025 Sep 14 01:05:25.354181 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-df9d231f-1088-4a56-a6d9-9f2ecdd3da7b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:25.355754 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 50/109] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:24 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:25.361087 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-be9b3eea-6144-483a-92e1-461ba6b42ef6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:25.361970 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-be9b3eea-6144-483a-92e1-461ba6b42ef6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:25.368499 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-df9d231f-1088-4a56-a6d9-9f2ecdd3da7b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1368 microversion: 2.1 time: 0.353787 Sep 14 01:05:25.369524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 60/110] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:25 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1368 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:25.371291 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-be9b3eea-6144-483a-92e1-461ba6b42ef6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:25.372013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-be9b3eea-6144-483a-92e1-461ba6b42ef6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:25.372595 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-be9b3eea-6144-483a-92e1-461ba6b42ef6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:25.373451 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-be9b3eea-6144-483a-92e1-461ba6b42ef6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:25.374251 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-be9b3eea-6144-483a-92e1-461ba6b42ef6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:25.374839 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-be9b3eea-6144-483a-92e1-461ba6b42ef6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:25.683611 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-be9b3eea-6144-483a-92e1-461ba6b42ef6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:25.692463 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-be9b3eea-6144-483a-92e1-461ba6b42ef6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1321 microversion: 2.1 time: 0.335457 Sep 14 01:05:25.693051 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 51/111] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:25 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:25.812693 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-54467f05-474d-4403-b034-3c2426b990d2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:25.813457 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-54467f05-474d-4403-b034-3c2426b990d2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:25.820960 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54467f05-474d-4403-b034-3c2426b990d2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:25.821707 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54467f05-474d-4403-b034-3c2426b990d2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:25.822367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54467f05-474d-4403-b034-3c2426b990d2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:25.823444 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54467f05-474d-4403-b034-3c2426b990d2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:25.824365 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54467f05-474d-4403-b034-3c2426b990d2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:25.825090 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54467f05-474d-4403-b034-3c2426b990d2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:26.037233 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0e351b06-3fa7-4c9b-87fc-069fe16b365b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:26.037945 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0e351b06-3fa7-4c9b-87fc-069fe16b365b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:26.049761 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0e351b06-3fa7-4c9b-87fc-069fe16b365b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:26.052013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0e351b06-3fa7-4c9b-87fc-069fe16b365b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:26.053123 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0e351b06-3fa7-4c9b-87fc-069fe16b365b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:26.054750 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0e351b06-3fa7-4c9b-87fc-069fe16b365b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:26.056904 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0e351b06-3fa7-4c9b-87fc-069fe16b365b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:26.058026 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0e351b06-3fa7-4c9b-87fc-069fe16b365b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:26.096020 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-54467f05-474d-4403-b034-3c2426b990d2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:26.113664 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-54467f05-474d-4403-b034-3c2426b990d2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 0.305714 Sep 14 01:05:26.116488 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 61/112] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:25 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:26.381319 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8e5051fc-f538-4ebc-90e5-a56606697174 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:26.382032 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8e5051fc-f538-4ebc-90e5-a56606697174 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:26.388881 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8e5051fc-f538-4ebc-90e5-a56606697174 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:26.389640 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8e5051fc-f538-4ebc-90e5-a56606697174 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:26.390207 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8e5051fc-f538-4ebc-90e5-a56606697174 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:26.390904 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8e5051fc-f538-4ebc-90e5-a56606697174 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:26.391416 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8e5051fc-f538-4ebc-90e5-a56606697174 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:26.391871 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8e5051fc-f538-4ebc-90e5-a56606697174 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:26.437248 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0e351b06-3fa7-4c9b-87fc-069fe16b365b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:26.457900 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0e351b06-3fa7-4c9b-87fc-069fe16b365b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:26.461270 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0e351b06-3fa7-4c9b-87fc-069fe16b365b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:26.462753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0e351b06-3fa7-4c9b-87fc-069fe16b365b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1406 microversion: 2.20 time: 0.433779 Sep 14 01:05:26.511196 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 52/113] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:26 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1406 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:26.526559 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-bf97c098-2b59-46a1-842d-6fc24432a4c8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:26.527583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-bf97c098-2b59-46a1-842d-6fc24432a4c8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:26.538639 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bf97c098-2b59-46a1-842d-6fc24432a4c8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:26.539904 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bf97c098-2b59-46a1-842d-6fc24432a4c8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:26.540574 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bf97c098-2b59-46a1-842d-6fc24432a4c8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:26.541883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bf97c098-2b59-46a1-842d-6fc24432a4c8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:26.542503 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bf97c098-2b59-46a1-842d-6fc24432a4c8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:26.543124 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bf97c098-2b59-46a1-842d-6fc24432a4c8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:26.690471 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8e5051fc-f538-4ebc-90e5-a56606697174 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:26.701100 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8e5051fc-f538-4ebc-90e5-a56606697174 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.324174 Sep 14 01:05:26.713759 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 62/114] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:26 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:26.723959 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-fad9aec2-df22-4528-ae33-0c3015c18af1 req-f8034fb4-6fd8-4cdd-b5d0-6a771beefb31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e701782-aa36-44dd-be23-a59054d8cb32", "tag": "620985b6-d85e-4dfc-884a-1a64043ee00d"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:26.739159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-fad9aec2-df22-4528-ae33-0c3015c18af1 req-f8034fb4-6fd8-4cdd-b5d0-6a771beefb31 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:26.740408 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-fad9aec2-df22-4528-ae33-0c3015c18af1 req-f8034fb4-6fd8-4cdd-b5d0-6a771beefb31 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:26.741322 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-fad9aec2-df22-4528-ae33-0c3015c18af1 req-f8034fb4-6fd8-4cdd-b5d0-6a771beefb31 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:26.758996 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-fad9aec2-df22-4528-ae33-0c3015c18af1 req-f8034fb4-6fd8-4cdd-b5d0-6a771beefb31 service nova] Creating event network-changed:620985b6-d85e-4dfc-884a-1a64043ee00d for instance 5e701782-aa36-44dd-be23-a59054d8cb32 on hv-cinder-85752 Sep 14 01:05:26.765727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-fad9aec2-df22-4528-ae33-0c3015c18af1 req-f8034fb4-6fd8-4cdd-b5d0-6a771beefb31 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050356 Sep 14 01:05:26.766683 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 63/115] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:05:26.767660 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bf97c098-2b59-46a1-842d-6fc24432a4c8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:26.772696 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0945e0b1-7880-4476-a128-51430b156c46 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:26.773463 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0945e0b1-7880-4476-a128-51430b156c46 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:26.781130 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0945e0b1-7880-4476-a128-51430b156c46 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:26.781681 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0945e0b1-7880-4476-a128-51430b156c46 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:26.782115 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0945e0b1-7880-4476-a128-51430b156c46 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:26.782806 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0945e0b1-7880-4476-a128-51430b156c46 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:26.783253 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0945e0b1-7880-4476-a128-51430b156c46 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:26.783767 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0945e0b1-7880-4476-a128-51430b156c46 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:26.788710 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-bf97c098-2b59-46a1-842d-6fc24432a4c8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1368 microversion: 2.1 time: 0.272813 Sep 14 01:05:26.791716 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 53/116] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:26 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1368 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:26.980785 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0945e0b1-7880-4476-a128-51430b156c46 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:26.989890 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0945e0b1-7880-4476-a128-51430b156c46 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1321 microversion: 2.1 time: 0.222067 Sep 14 01:05:26.991244 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 64/117] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:26 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:27.142339 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d16541da-e36c-434c-8586-775058fd9f5e tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:27.143032 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d16541da-e36c-434c-8586-775058fd9f5e tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:27.151252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d16541da-e36c-434c-8586-775058fd9f5e tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:27.151837 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d16541da-e36c-434c-8586-775058fd9f5e tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:27.152450 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d16541da-e36c-434c-8586-775058fd9f5e tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:27.153165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d16541da-e36c-434c-8586-775058fd9f5e tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:27.153619 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d16541da-e36c-434c-8586-775058fd9f5e tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:27.154500 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d16541da-e36c-434c-8586-775058fd9f5e tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:27.382067 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d16541da-e36c-434c-8586-775058fd9f5e tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:27.391148 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d16541da-e36c-434c-8586-775058fd9f5e tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 0.255948 Sep 14 01:05:27.391756 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 54/118] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:27 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:27.495074 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2b242682-9e7b-40ec-b0cf-b38c95cf83c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:27.495787 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2b242682-9e7b-40ec-b0cf-b38c95cf83c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:27.502530 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2b242682-9e7b-40ec-b0cf-b38c95cf83c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:27.503317 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2b242682-9e7b-40ec-b0cf-b38c95cf83c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:27.504029 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2b242682-9e7b-40ec-b0cf-b38c95cf83c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:27.505000 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2b242682-9e7b-40ec-b0cf-b38c95cf83c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:27.506257 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2b242682-9e7b-40ec-b0cf-b38c95cf83c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:27.506864 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2b242682-9e7b-40ec-b0cf-b38c95cf83c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:27.665960 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2b242682-9e7b-40ec-b0cf-b38c95cf83c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:27.675577 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2b242682-9e7b-40ec-b0cf-b38c95cf83c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:27.677822 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2b242682-9e7b-40ec-b0cf-b38c95cf83c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:27.679364 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2b242682-9e7b-40ec-b0cf-b38c95cf83c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1406 microversion: 2.20 time: 0.188475 Sep 14 01:05:27.679962 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 65/119] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:27 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:27.726228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-1e8822b6-5dd2-421a-8e4d-0b02dba33362 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:27.726848 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-1e8822b6-5dd2-421a-8e4d-0b02dba33362 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:27.733196 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1e8822b6-5dd2-421a-8e4d-0b02dba33362 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:27.733870 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1e8822b6-5dd2-421a-8e4d-0b02dba33362 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:27.734301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1e8822b6-5dd2-421a-8e4d-0b02dba33362 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:27.735139 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1e8822b6-5dd2-421a-8e4d-0b02dba33362 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:27.735792 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1e8822b6-5dd2-421a-8e4d-0b02dba33362 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:27.736397 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1e8822b6-5dd2-421a-8e4d-0b02dba33362 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:27.815982 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-dbb50679-cfa1-4d96-a5a1-edf486d6d7de tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:27.816704 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-dbb50679-cfa1-4d96-a5a1-edf486d6d7de tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:27.824636 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dbb50679-cfa1-4d96-a5a1-edf486d6d7de tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:27.825201 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dbb50679-cfa1-4d96-a5a1-edf486d6d7de tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:27.825715 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dbb50679-cfa1-4d96-a5a1-edf486d6d7de tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:27.826547 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dbb50679-cfa1-4d96-a5a1-edf486d6d7de tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:27.827199 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dbb50679-cfa1-4d96-a5a1-edf486d6d7de tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:27.827713 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dbb50679-cfa1-4d96-a5a1-edf486d6d7de tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:28.005761 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-dbb50679-cfa1-4d96-a5a1-edf486d6d7de tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:28.018412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-dbb50679-cfa1-4d96-a5a1-edf486d6d7de tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1368 microversion: 2.1 time: 0.205570 Sep 14 01:05:28.019754 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 66/120] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:27 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:28.041494 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8472c06f-0501-4da4-b2fe-7185e19936a6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:28.044399 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8472c06f-0501-4da4-b2fe-7185e19936a6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:28.059491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8472c06f-0501-4da4-b2fe-7185e19936a6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:28.060022 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8472c06f-0501-4da4-b2fe-7185e19936a6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:28.060460 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8472c06f-0501-4da4-b2fe-7185e19936a6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:28.062833 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8472c06f-0501-4da4-b2fe-7185e19936a6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:28.063311 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8472c06f-0501-4da4-b2fe-7185e19936a6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:28.065539 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8472c06f-0501-4da4-b2fe-7185e19936a6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:28.223143 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-1e8822b6-5dd2-421a-8e4d-0b02dba33362 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:28.229457 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=100 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:28.240014 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-1e8822b6-5dd2-421a-8e4d-0b02dba33362 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.517292 Sep 14 01:05:28.240918 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 55/121] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:27 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:28.306779 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8472c06f-0501-4da4-b2fe-7185e19936a6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:28.314968 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8472c06f-0501-4da4-b2fe-7185e19936a6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1321 microversion: 2.1 time: 0.292130 Sep 14 01:05:28.316211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 67/122] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:28 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:28.415755 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a171f0ca-fec7-4f76-a2cd-b50a8688c686 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:28.416364 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a171f0ca-fec7-4f76-a2cd-b50a8688c686 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:28.424533 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a171f0ca-fec7-4f76-a2cd-b50a8688c686 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:28.425191 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a171f0ca-fec7-4f76-a2cd-b50a8688c686 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:28.425986 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a171f0ca-fec7-4f76-a2cd-b50a8688c686 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:28.429047 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a171f0ca-fec7-4f76-a2cd-b50a8688c686 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:28.429698 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a171f0ca-fec7-4f76-a2cd-b50a8688c686 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:28.430281 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a171f0ca-fec7-4f76-a2cd-b50a8688c686 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:28.680814 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a171f0ca-fec7-4f76-a2cd-b50a8688c686 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:28.707693 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c3d84f3e-0ca1-4cea-9d81-83b5de3806f0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:28.709777 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c3d84f3e-0ca1-4cea-9d81-83b5de3806f0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:28.710585 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a171f0ca-fec7-4f76-a2cd-b50a8688c686 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 0.300143 Sep 14 01:05:28.715278 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 56/123] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:28 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:28.720515 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c3d84f3e-0ca1-4cea-9d81-83b5de3806f0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:28.722500 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c3d84f3e-0ca1-4cea-9d81-83b5de3806f0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:28.723764 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c3d84f3e-0ca1-4cea-9d81-83b5de3806f0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:28.725804 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c3d84f3e-0ca1-4cea-9d81-83b5de3806f0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:28.726483 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c3d84f3e-0ca1-4cea-9d81-83b5de3806f0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:28.729137 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c3d84f3e-0ca1-4cea-9d81-83b5de3806f0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:28.783480 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-1464588e-5ea8-4982-a4e7-f5a7ac630b26 req-6ad1ca05-a2b7-49e1-a8ff-a608773b91fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02da4a4-64f7-47c0-a48f-9cdb71f30df9", "tag": "61ac6a9d-d543-4896-a237-b3287bcd2644"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:28.804724 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-1464588e-5ea8-4982-a4e7-f5a7ac630b26 req-6ad1ca05-a2b7-49e1-a8ff-a608773b91fd service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:28.805344 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-1464588e-5ea8-4982-a4e7-f5a7ac630b26 req-6ad1ca05-a2b7-49e1-a8ff-a608773b91fd service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:28.805976 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-1464588e-5ea8-4982-a4e7-f5a7ac630b26 req-6ad1ca05-a2b7-49e1-a8ff-a608773b91fd service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:28.853260 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-1464588e-5ea8-4982-a4e7-f5a7ac630b26 req-6ad1ca05-a2b7-49e1-a8ff-a608773b91fd service nova] Creating event network-changed:61ac6a9d-d543-4896-a237-b3287bcd2644 for instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 on hv-cinder-85752 Sep 14 01:05:28.853788 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-1464588e-5ea8-4982-a4e7-f5a7ac630b26 req-6ad1ca05-a2b7-49e1-a8ff-a608773b91fd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120620) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 01:05:28.857714 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-1464588e-5ea8-4982-a4e7-f5a7ac630b26 req-6ad1ca05-a2b7-49e1-a8ff-a608773b91fd service nova] Acquired lock "compute-rpcapi-router" {{(pid=120620) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 01:05:28.860082 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fceabbbb-d794-40cd-9270-d0df57c96440 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:28.860790 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fceabbbb-d794-40cd-9270-d0df57c96440 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:28.862559 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fceabbbb-d794-40cd-9270-d0df57c96440 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:28.864461 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fceabbbb-d794-40cd-9270-d0df57c96440 None None] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:28.867215 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fceabbbb-d794-40cd-9270-d0df57c96440 None None] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:28.868842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fceabbbb-d794-40cd-9270-d0df57c96440 None None] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:28.885370 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.compute.rpcapi [None req-fceabbbb-d794-40cd-9270-d0df57c96440 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 14 01:05:28.887388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fceabbbb-d794-40cd-9270-d0df57c96440 None None] Releasing lock "compute-rpcapi-router" {{(pid=120620) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 01:05:28.907170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-fceabbbb-d794-40cd-9270-d0df57c96440 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128781 Sep 14 01:05:28.908790 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 57/124] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:05:28.960423 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c3d84f3e-0ca1-4cea-9d81-83b5de3806f0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:28.971535 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c3d84f3e-0ca1-4cea-9d81-83b5de3806f0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:28.973005 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c3d84f3e-0ca1-4cea-9d81-83b5de3806f0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:28.979703 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c3d84f3e-0ca1-4cea-9d81-83b5de3806f0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1406 microversion: 2.20 time: 0.276084 Sep 14 01:05:28.984012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 68/125] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:28 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:05:29.045314 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0e7a5dd1-c1ad-4bde-9089-f0b6a44bc0bc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:29.046636 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0e7a5dd1-c1ad-4bde-9089-f0b6a44bc0bc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:29.071503 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0e7a5dd1-c1ad-4bde-9089-f0b6a44bc0bc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:29.073202 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0e7a5dd1-c1ad-4bde-9089-f0b6a44bc0bc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:29.073856 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0e7a5dd1-c1ad-4bde-9089-f0b6a44bc0bc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:29.077032 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0e7a5dd1-c1ad-4bde-9089-f0b6a44bc0bc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:29.077746 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0e7a5dd1-c1ad-4bde-9089-f0b6a44bc0bc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:29.080367 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0e7a5dd1-c1ad-4bde-9089-f0b6a44bc0bc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:29.266274 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6cc85a0e-ec29-47eb-8694-99178534a12e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:29.267026 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6cc85a0e-ec29-47eb-8694-99178534a12e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:29.277609 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6cc85a0e-ec29-47eb-8694-99178534a12e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:29.278909 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6cc85a0e-ec29-47eb-8694-99178534a12e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:29.280272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6cc85a0e-ec29-47eb-8694-99178534a12e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:29.281280 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6cc85a0e-ec29-47eb-8694-99178534a12e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:29.282406 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6cc85a0e-ec29-47eb-8694-99178534a12e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:29.283019 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6cc85a0e-ec29-47eb-8694-99178534a12e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:29.435634 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:29.438720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0e7a5dd1-c1ad-4bde-9089-f0b6a44bc0bc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:29.447266 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0e7a5dd1-c1ad-4bde-9089-f0b6a44bc0bc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1368 microversion: 2.1 time: 0.407795 Sep 14 01:05:29.449102 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 58/126] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:29 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1368 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:29.455127 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-59876de0-d990-4b9a-941c-cdd94a3cfe0b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:29.455932 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-59876de0-d990-4b9a-941c-cdd94a3cfe0b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:29.462703 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-59876de0-d990-4b9a-941c-cdd94a3cfe0b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:29.463475 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-59876de0-d990-4b9a-941c-cdd94a3cfe0b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:29.464145 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-59876de0-d990-4b9a-941c-cdd94a3cfe0b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:29.465022 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-59876de0-d990-4b9a-941c-cdd94a3cfe0b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:29.465644 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-59876de0-d990-4b9a-941c-cdd94a3cfe0b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:29.466418 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-59876de0-d990-4b9a-941c-cdd94a3cfe0b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:29.511853 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6cc85a0e-ec29-47eb-8694-99178534a12e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:29.526624 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6cc85a0e-ec29-47eb-8694-99178534a12e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.262707 Sep 14 01:05:29.531802 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 69/127] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:29 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:29.647711 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-59876de0-d990-4b9a-941c-cdd94a3cfe0b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:29.657283 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-59876de0-d990-4b9a-941c-cdd94a3cfe0b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1321 microversion: 2.1 time: 0.206726 Sep 14 01:05:29.657955 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 59/128] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:29 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:29.741690 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4e8d3153-acb4-45c5-91c9-aa2c1c26674a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:29.742400 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4e8d3153-acb4-45c5-91c9-aa2c1c26674a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:29.749151 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4e8d3153-acb4-45c5-91c9-aa2c1c26674a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:29.749884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4e8d3153-acb4-45c5-91c9-aa2c1c26674a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:29.750594 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4e8d3153-acb4-45c5-91c9-aa2c1c26674a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:29.751462 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4e8d3153-acb4-45c5-91c9-aa2c1c26674a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:29.752372 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4e8d3153-acb4-45c5-91c9-aa2c1c26674a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:29.752952 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4e8d3153-acb4-45c5-91c9-aa2c1c26674a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:29.944890 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4e8d3153-acb4-45c5-91c9-aa2c1c26674a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:29.953358 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4e8d3153-acb4-45c5-91c9-aa2c1c26674a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 0.215739 Sep 14 01:05:29.954099 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 70/129] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:29 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:30.013444 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-74f71593-c476-4518-9ee1-0b77fc6132e6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:30.014099 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-74f71593-c476-4518-9ee1-0b77fc6132e6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:30.024621 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-74f71593-c476-4518-9ee1-0b77fc6132e6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:30.025110 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-74f71593-c476-4518-9ee1-0b77fc6132e6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:30.028268 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-74f71593-c476-4518-9ee1-0b77fc6132e6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:30.029170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-74f71593-c476-4518-9ee1-0b77fc6132e6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:30.030773 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-74f71593-c476-4518-9ee1-0b77fc6132e6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:30.033588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-74f71593-c476-4518-9ee1-0b77fc6132e6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:30.260941 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-74f71593-c476-4518-9ee1-0b77fc6132e6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:30.275534 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-74f71593-c476-4518-9ee1-0b77fc6132e6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:30.278041 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-74f71593-c476-4518-9ee1-0b77fc6132e6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:30.279467 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-74f71593-c476-4518-9ee1-0b77fc6132e6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1406 microversion: 2.20 time: 0.270369 Sep 14 01:05:30.280493 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 60/130] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:30 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1406 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:30.479813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-884eb648-4d7a-4434-be98-8d37f33490d7 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:30.480908 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-884eb648-4d7a-4434-be98-8d37f33490d7 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:30.491260 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-884eb648-4d7a-4434-be98-8d37f33490d7 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:30.491858 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-884eb648-4d7a-4434-be98-8d37f33490d7 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:30.492785 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-884eb648-4d7a-4434-be98-8d37f33490d7 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:30.493511 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-884eb648-4d7a-4434-be98-8d37f33490d7 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:30.494088 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-884eb648-4d7a-4434-be98-8d37f33490d7 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:30.494641 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-884eb648-4d7a-4434-be98-8d37f33490d7 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:30.554116 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-080a0b0f-8185-430a-9c15-446c7d10a3ed tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:30.554727 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-080a0b0f-8185-430a-9c15-446c7d10a3ed tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:30.561460 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-080a0b0f-8185-430a-9c15-446c7d10a3ed tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:30.562172 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-080a0b0f-8185-430a-9c15-446c7d10a3ed tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:30.562758 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-080a0b0f-8185-430a-9c15-446c7d10a3ed tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:30.563757 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-080a0b0f-8185-430a-9c15-446c7d10a3ed tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:30.564403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-080a0b0f-8185-430a-9c15-446c7d10a3ed tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:30.565013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-080a0b0f-8185-430a-9c15-446c7d10a3ed tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:30.683242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-884eb648-4d7a-4434-be98-8d37f33490d7 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:30.695038 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-884eb648-4d7a-4434-be98-8d37f33490d7 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1368 microversion: 2.1 time: 0.219425 Sep 14 01:05:30.695693 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 71/131] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:30 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:30.712945 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b8bcf689-181a-4f01-95d7-d7988fe2d107 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:30.713990 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b8bcf689-181a-4f01-95d7-d7988fe2d107 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:30.724920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8bcf689-181a-4f01-95d7-d7988fe2d107 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:30.727233 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8bcf689-181a-4f01-95d7-d7988fe2d107 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:30.727979 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-080a0b0f-8185-430a-9c15-446c7d10a3ed tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:30.728779 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8bcf689-181a-4f01-95d7-d7988fe2d107 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:30.730191 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8bcf689-181a-4f01-95d7-d7988fe2d107 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:30.731593 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8bcf689-181a-4f01-95d7-d7988fe2d107 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:30.732642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8bcf689-181a-4f01-95d7-d7988fe2d107 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:30.739185 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-080a0b0f-8185-430a-9c15-446c7d10a3ed tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.189845 Sep 14 01:05:30.740261 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 61/132] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:30 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:30.921917 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b8bcf689-181a-4f01-95d7-d7988fe2d107 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:30.930987 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b8bcf689-181a-4f01-95d7-d7988fe2d107 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1321 microversion: 2.1 time: 0.233881 Sep 14 01:05:30.932296 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 72/133] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:30 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:30.987004 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b908e493-fd55-4853-a1a9-b9d9b8ced2de tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:30.988081 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b908e493-fd55-4853-a1a9-b9d9b8ced2de tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:30.998252 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b908e493-fd55-4853-a1a9-b9d9b8ced2de tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:30.998957 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b908e493-fd55-4853-a1a9-b9d9b8ced2de tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:30.999526 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b908e493-fd55-4853-a1a9-b9d9b8ced2de tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:31.000412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b908e493-fd55-4853-a1a9-b9d9b8ced2de tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:31.001228 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b908e493-fd55-4853-a1a9-b9d9b8ced2de tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:31.001875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b908e493-fd55-4853-a1a9-b9d9b8ced2de tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:31.125969 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-37163383-aaea-4b7c-8dd1-3e5c96fa436e req-f2650c24-eff2-496c-905f-ee263cf92027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96664d10-3eeb-4172-b866-7d824c2310d3", "name": "network-vif-plugged", "status": "completed", "tag": "dd7f3405-9f9e-4062-a010-7d8bae1bc828"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:31.136962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-37163383-aaea-4b7c-8dd1-3e5c96fa436e req-f2650c24-eff2-496c-905f-ee263cf92027 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:31.137438 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-37163383-aaea-4b7c-8dd1-3e5c96fa436e req-f2650c24-eff2-496c-905f-ee263cf92027 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:31.137865 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-37163383-aaea-4b7c-8dd1-3e5c96fa436e req-f2650c24-eff2-496c-905f-ee263cf92027 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:31.151626 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-37163383-aaea-4b7c-8dd1-3e5c96fa436e req-f2650c24-eff2-496c-905f-ee263cf92027 service nova] Creating event network-vif-plugged:dd7f3405-9f9e-4062-a010-7d8bae1bc828 for instance 96664d10-3eeb-4172-b866-7d824c2310d3 on hv-cinder-85752 Sep 14 01:05:31.157160 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-37163383-aaea-4b7c-8dd1-3e5c96fa436e req-f2650c24-eff2-496c-905f-ee263cf92027 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.310381 Sep 14 01:05:31.158094 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 62/134] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:05:31.209701 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b908e493-fd55-4853-a1a9-b9d9b8ced2de tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:31.224697 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b908e493-fd55-4853-a1a9-b9d9b8ced2de tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 0.243128 Sep 14 01:05:31.225981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 73/135] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:30 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:31.311533 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-266c657f-bca8-4eef-8491-bb5ad591a93f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:31.312417 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-266c657f-bca8-4eef-8491-bb5ad591a93f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:31.318751 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-266c657f-bca8-4eef-8491-bb5ad591a93f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:31.319292 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-266c657f-bca8-4eef-8491-bb5ad591a93f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:31.319790 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-266c657f-bca8-4eef-8491-bb5ad591a93f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:31.324239 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-266c657f-bca8-4eef-8491-bb5ad591a93f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:31.324726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-266c657f-bca8-4eef-8491-bb5ad591a93f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:31.326209 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-266c657f-bca8-4eef-8491-bb5ad591a93f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:31.722402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-93f360ab-649f-467d-9b92-6f10b7770715 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:31.723267 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-93f360ab-649f-467d-9b92-6f10b7770715 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:31.732589 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-93f360ab-649f-467d-9b92-6f10b7770715 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:31.734226 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-93f360ab-649f-467d-9b92-6f10b7770715 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:31.735419 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-93f360ab-649f-467d-9b92-6f10b7770715 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:31.736259 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-93f360ab-649f-467d-9b92-6f10b7770715 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:31.736840 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-93f360ab-649f-467d-9b92-6f10b7770715 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:31.741671 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-93f360ab-649f-467d-9b92-6f10b7770715 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:32.330991 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-93f360ab-649f-467d-9b92-6f10b7770715 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:32.344770 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-93f360ab-649f-467d-9b92-6f10b7770715 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1368 microversion: 2.1 time: 0.626576 Sep 14 01:05:32.364054 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 74/136] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:31 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1368 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:32.365528 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-266c657f-bca8-4eef-8491-bb5ad591a93f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:32.385323 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-266c657f-bca8-4eef-8491-bb5ad591a93f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:32.386780 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-266c657f-bca8-4eef-8491-bb5ad591a93f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:32.387929 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-266c657f-bca8-4eef-8491-bb5ad591a93f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1406 microversion: 2.20 time: 1.081675 Sep 14 01:05:32.388491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 63/137] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:31 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1406 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:32.392335 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-455d5fbd-0371-469a-96ed-5ccf322184ba tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:32.393546 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-455d5fbd-0371-469a-96ed-5ccf322184ba tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:32.398117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-1fef2be1-13a0-4b40-90e3-dca320f5b4b8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:32.398729 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-1fef2be1-13a0-4b40-90e3-dca320f5b4b8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:32.401248 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-455d5fbd-0371-469a-96ed-5ccf322184ba tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:32.401926 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-455d5fbd-0371-469a-96ed-5ccf322184ba tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:32.402415 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-455d5fbd-0371-469a-96ed-5ccf322184ba tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:32.403191 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-455d5fbd-0371-469a-96ed-5ccf322184ba tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:32.404110 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-455d5fbd-0371-469a-96ed-5ccf322184ba tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:32.404718 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-455d5fbd-0371-469a-96ed-5ccf322184ba tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:32.420592 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1fef2be1-13a0-4b40-90e3-dca320f5b4b8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:32.421083 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1fef2be1-13a0-4b40-90e3-dca320f5b4b8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:32.424328 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1fef2be1-13a0-4b40-90e3-dca320f5b4b8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:32.425239 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1fef2be1-13a0-4b40-90e3-dca320f5b4b8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:32.430239 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1fef2be1-13a0-4b40-90e3-dca320f5b4b8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:32.431224 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1fef2be1-13a0-4b40-90e3-dca320f5b4b8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:32.749689 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-455d5fbd-0371-469a-96ed-5ccf322184ba tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:32.777700 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-1fef2be1-13a0-4b40-90e3-dca320f5b4b8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:32.779251 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-455d5fbd-0371-469a-96ed-5ccf322184ba tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.409752 Sep 14 01:05:32.781657 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 75/138] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:32 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:32.791980 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-1fef2be1-13a0-4b40-90e3-dca320f5b4b8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1321 microversion: 2.1 time: 0.402138 Sep 14 01:05:32.792576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 64/139] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:32 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1321 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:32.803853 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0f704497-59f8-4d00-86b1-27ea69c67c0a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:32.803853 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0f704497-59f8-4d00-86b1-27ea69c67c0a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:32.817044 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0f704497-59f8-4d00-86b1-27ea69c67c0a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:32.818722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0f704497-59f8-4d00-86b1-27ea69c67c0a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:32.819258 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0f704497-59f8-4d00-86b1-27ea69c67c0a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:32.820282 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0f704497-59f8-4d00-86b1-27ea69c67c0a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:32.821201 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0f704497-59f8-4d00-86b1-27ea69c67c0a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:32.822284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0f704497-59f8-4d00-86b1-27ea69c67c0a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:32.827458 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:32.973216 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0f704497-59f8-4d00-86b1-27ea69c67c0a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:32.982000 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0f704497-59f8-4d00-86b1-27ea69c67c0a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 0.197412 Sep 14 01:05:32.982895 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 76/140] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:32 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:33.373030 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-f6b60c0d-2a24-4224-ae2b-a038c4084268 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:33.373807 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-f6b60c0d-2a24-4224-ae2b-a038c4084268 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:33.388240 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f6b60c0d-2a24-4224-ae2b-a038c4084268 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:33.391770 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f6b60c0d-2a24-4224-ae2b-a038c4084268 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:33.392252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f6b60c0d-2a24-4224-ae2b-a038c4084268 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:33.394219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f6b60c0d-2a24-4224-ae2b-a038c4084268 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:33.394699 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f6b60c0d-2a24-4224-ae2b-a038c4084268 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:33.396706 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f6b60c0d-2a24-4224-ae2b-a038c4084268 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:33.420381 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-432a789c-7090-4382-9fbe-2485ee6943a2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:33.420925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-432a789c-7090-4382-9fbe-2485ee6943a2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:33.430819 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-432a789c-7090-4382-9fbe-2485ee6943a2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:33.431314 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-432a789c-7090-4382-9fbe-2485ee6943a2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:33.431783 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-432a789c-7090-4382-9fbe-2485ee6943a2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:33.436112 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-432a789c-7090-4382-9fbe-2485ee6943a2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:33.436595 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-432a789c-7090-4382-9fbe-2485ee6943a2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:33.438635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-432a789c-7090-4382-9fbe-2485ee6943a2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:33.578559 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-f6b60c0d-2a24-4224-ae2b-a038c4084268 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:33.597828 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-f6b60c0d-2a24-4224-ae2b-a038c4084268 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1368 microversion: 2.1 time: 0.229991 Sep 14 01:05:33.598417 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 65/141] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:33 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:33.653600 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-432a789c-7090-4382-9fbe-2485ee6943a2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:33.664622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-432a789c-7090-4382-9fbe-2485ee6943a2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:33.666606 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-432a789c-7090-4382-9fbe-2485ee6943a2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:33.667921 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-432a789c-7090-4382-9fbe-2485ee6943a2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1406 microversion: 2.20 time: 0.252491 Sep 14 01:05:33.680585 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 77/142] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:33 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:33.809521 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-5ea74601-6858-4061-934d-9f042c81e98b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:33.811958 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-5ea74601-6858-4061-934d-9f042c81e98b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:33.816901 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:33.817743 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f348311b-b1be-4d69-9b85-ba26bdd0abdb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:33.818916 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f348311b-b1be-4d69-9b85-ba26bdd0abdb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:33.821165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5ea74601-6858-4061-934d-9f042c81e98b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:33.823527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5ea74601-6858-4061-934d-9f042c81e98b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:33.824870 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f348311b-b1be-4d69-9b85-ba26bdd0abdb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:33.825267 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5ea74601-6858-4061-934d-9f042c81e98b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:33.825371 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f348311b-b1be-4d69-9b85-ba26bdd0abdb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:33.825777 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f348311b-b1be-4d69-9b85-ba26bdd0abdb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:33.826140 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5ea74601-6858-4061-934d-9f042c81e98b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:33.826468 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f348311b-b1be-4d69-9b85-ba26bdd0abdb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:33.826925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f348311b-b1be-4d69-9b85-ba26bdd0abdb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:33.827348 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f348311b-b1be-4d69-9b85-ba26bdd0abdb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:33.827618 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5ea74601-6858-4061-934d-9f042c81e98b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:33.828836 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5ea74601-6858-4061-934d-9f042c81e98b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:33.991674 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-5ea74601-6858-4061-934d-9f042c81e98b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:33.995356 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f348311b-b1be-4d69-9b85-ba26bdd0abdb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:34.003163 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f348311b-b1be-4d69-9b85-ba26bdd0abdb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1321 microversion: 2.1 time: 0.189547 Sep 14 01:05:34.003321 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-5ea74601-6858-4061-934d-9f042c81e98b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.197689 Sep 14 01:05:34.003780 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 78/143] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:33 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:34.008537 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ed7d15f1-ce08-4950-a6e1-08e7d704a673 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:34.009135 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ed7d15f1-ce08-4950-a6e1-08e7d704a673 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:34.020344 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ed7d15f1-ce08-4950-a6e1-08e7d704a673 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:34.021290 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ed7d15f1-ce08-4950-a6e1-08e7d704a673 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:34.021726 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ed7d15f1-ce08-4950-a6e1-08e7d704a673 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:34.022407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ed7d15f1-ce08-4950-a6e1-08e7d704a673 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:34.022860 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ed7d15f1-ce08-4950-a6e1-08e7d704a673 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:34.023280 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ed7d15f1-ce08-4950-a6e1-08e7d704a673 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:34.023585 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 66/144] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:33 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:34.187248 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ed7d15f1-ce08-4950-a6e1-08e7d704a673 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:34.197800 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ed7d15f1-ce08-4950-a6e1-08e7d704a673 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 0.192788 Sep 14 01:05:34.198766 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 79/145] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:34 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:34.620836 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6cb2f3f0-18ba-4ef1-ad86-e9bf433bcd4c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:34.622085 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-6cb2f3f0-18ba-4ef1-ad86-e9bf433bcd4c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:34.628892 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6cb2f3f0-18ba-4ef1-ad86-e9bf433bcd4c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:34.629380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6cb2f3f0-18ba-4ef1-ad86-e9bf433bcd4c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:34.629821 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6cb2f3f0-18ba-4ef1-ad86-e9bf433bcd4c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:34.630598 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6cb2f3f0-18ba-4ef1-ad86-e9bf433bcd4c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:34.631165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6cb2f3f0-18ba-4ef1-ad86-e9bf433bcd4c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:34.631621 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6cb2f3f0-18ba-4ef1-ad86-e9bf433bcd4c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:34.696270 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-29ba918b-6aa3-4570-9e80-48a8894655c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:34.697487 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-29ba918b-6aa3-4570-9e80-48a8894655c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:34.704361 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-29ba918b-6aa3-4570-9e80-48a8894655c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:34.705030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-29ba918b-6aa3-4570-9e80-48a8894655c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:34.705808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-29ba918b-6aa3-4570-9e80-48a8894655c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:34.706930 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-29ba918b-6aa3-4570-9e80-48a8894655c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:34.707429 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-29ba918b-6aa3-4570-9e80-48a8894655c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:34.708051 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-29ba918b-6aa3-4570-9e80-48a8894655c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:34.904018 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6cb2f3f0-18ba-4ef1-ad86-e9bf433bcd4c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:34.912641 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-6cb2f3f0-18ba-4ef1-ad86-e9bf433bcd4c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1368 microversion: 2.1 time: 0.295516 Sep 14 01:05:34.929285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 67/146] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:34 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1368 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:35.033484 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4d7a9c9e-c6a8-4c57-9f23-b8f4cecb03bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:35.034866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4d7a9c9e-c6a8-4c57-9f23-b8f4cecb03bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:35.044287 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d7a9c9e-c6a8-4c57-9f23-b8f4cecb03bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:35.045107 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d7a9c9e-c6a8-4c57-9f23-b8f4cecb03bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:35.045908 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d7a9c9e-c6a8-4c57-9f23-b8f4cecb03bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:35.046992 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d7a9c9e-c6a8-4c57-9f23-b8f4cecb03bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:35.047840 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d7a9c9e-c6a8-4c57-9f23-b8f4cecb03bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:35.048695 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d7a9c9e-c6a8-4c57-9f23-b8f4cecb03bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:35.131937 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-29ba918b-6aa3-4570-9e80-48a8894655c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:35.140465 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-29ba918b-6aa3-4570-9e80-48a8894655c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:35.142657 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-29ba918b-6aa3-4570-9e80-48a8894655c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:35.144335 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-29ba918b-6aa3-4570-9e80-48a8894655c0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1406 microversion: 2.20 time: 0.453436 Sep 14 01:05:35.167694 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 80/147] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:34 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:05:35.173875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f3c0d1fe-1cc2-446b-ade8-74993b0e4ce0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:35.174485 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f3c0d1fe-1cc2-446b-ade8-74993b0e4ce0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:35.182165 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f3c0d1fe-1cc2-446b-ade8-74993b0e4ce0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:35.183244 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f3c0d1fe-1cc2-446b-ade8-74993b0e4ce0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:35.183915 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f3c0d1fe-1cc2-446b-ade8-74993b0e4ce0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:35.184995 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f3c0d1fe-1cc2-446b-ade8-74993b0e4ce0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:35.186005 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f3c0d1fe-1cc2-446b-ade8-74993b0e4ce0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:35.186652 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f3c0d1fe-1cc2-446b-ade8-74993b0e4ce0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:35.402697 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f3c0d1fe-1cc2-446b-ade8-74993b0e4ce0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:35.412288 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4d7a9c9e-c6a8-4c57-9f23-b8f4cecb03bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:35.414670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f3c0d1fe-1cc2-446b-ade8-74993b0e4ce0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.241748 Sep 14 01:05:35.415892 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 81/148] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:35 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:35.435268 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-bb9ecf36-c129-48bb-8112-d3bb00b4fc39 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:35.436329 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-bb9ecf36-c129-48bb-8112-d3bb00b4fc39 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:35.446438 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4d7a9c9e-c6a8-4c57-9f23-b8f4cecb03bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1321 microversion: 2.1 time: 0.419743 Sep 14 01:05:35.447411 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 68/149] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:35 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1321 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:35.450406 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bb9ecf36-c129-48bb-8112-d3bb00b4fc39 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:35.451358 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bb9ecf36-c129-48bb-8112-d3bb00b4fc39 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:35.452022 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bb9ecf36-c129-48bb-8112-d3bb00b4fc39 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:35.452764 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-b19b6608-f77f-4db3-80b8-246625d12b81 req-a3f631d0-aecd-4a56-9f3b-b3d5bade1cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa", "name": "network-vif-plugged", "status": "completed", "tag": "0f1f31eb-05bc-4b3d-995e-4fba37dfe847"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:35.459348 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bb9ecf36-c129-48bb-8112-d3bb00b4fc39 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:35.460270 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bb9ecf36-c129-48bb-8112-d3bb00b4fc39 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:35.460951 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bb9ecf36-c129-48bb-8112-d3bb00b4fc39 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:35.476268 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-b19b6608-f77f-4db3-80b8-246625d12b81 req-a3f631d0-aecd-4a56-9f3b-b3d5bade1cc6 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:35.476858 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-b19b6608-f77f-4db3-80b8-246625d12b81 req-a3f631d0-aecd-4a56-9f3b-b3d5bade1cc6 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:35.479924 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-b19b6608-f77f-4db3-80b8-246625d12b81 req-a3f631d0-aecd-4a56-9f3b-b3d5bade1cc6 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:35.501784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-b19b6608-f77f-4db3-80b8-246625d12b81 req-a3f631d0-aecd-4a56-9f3b-b3d5bade1cc6 service nova] Creating event network-vif-plugged:0f1f31eb-05bc-4b3d-995e-4fba37dfe847 for instance 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa on hv-cinder-85752 Sep 14 01:05:35.507848 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-b19b6608-f77f-4db3-80b8-246625d12b81 req-a3f631d0-aecd-4a56-9f3b-b3d5bade1cc6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059027 Sep 14 01:05:35.508745 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 69/150] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:05:35.772840 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-bb9ecf36-c129-48bb-8112-d3bb00b4fc39 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:35.787766 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-bb9ecf36-c129-48bb-8112-d3bb00b4fc39 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 0.362971 Sep 14 01:05:35.787766 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 82/151] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:35 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:35.936861 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-19f2d933-a327-4c35-92bd-77ea95425e68 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:35.937579 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-19f2d933-a327-4c35-92bd-77ea95425e68 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:35.943704 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-19f2d933-a327-4c35-92bd-77ea95425e68 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:35.944174 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-19f2d933-a327-4c35-92bd-77ea95425e68 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:35.944601 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-19f2d933-a327-4c35-92bd-77ea95425e68 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:35.945277 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-19f2d933-a327-4c35-92bd-77ea95425e68 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:35.945822 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-19f2d933-a327-4c35-92bd-77ea95425e68 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:35.946242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-19f2d933-a327-4c35-92bd-77ea95425e68 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:36.077656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-19f2d933-a327-4c35-92bd-77ea95425e68 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:36.085815 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-19f2d933-a327-4c35-92bd-77ea95425e68 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1368 microversion: 2.1 time: 0.153404 Sep 14 01:05:36.086378 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 70/152] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:35 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:36.180555 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-576e5cd5-feaa-47f7-84e9-3915857c9be1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:36.181162 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-576e5cd5-feaa-47f7-84e9-3915857c9be1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:36.187062 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-576e5cd5-feaa-47f7-84e9-3915857c9be1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:36.187542 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-576e5cd5-feaa-47f7-84e9-3915857c9be1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:36.187997 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-576e5cd5-feaa-47f7-84e9-3915857c9be1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:36.188678 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-576e5cd5-feaa-47f7-84e9-3915857c9be1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:36.189128 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-576e5cd5-feaa-47f7-84e9-3915857c9be1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:36.189549 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-576e5cd5-feaa-47f7-84e9-3915857c9be1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:36.315293 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-576e5cd5-feaa-47f7-84e9-3915857c9be1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:36.323304 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-576e5cd5-feaa-47f7-84e9-3915857c9be1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:36.324782 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-576e5cd5-feaa-47f7-84e9-3915857c9be1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:36.325876 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-576e5cd5-feaa-47f7-84e9-3915857c9be1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1406 microversion: 2.20 time: 0.150003 Sep 14 01:05:36.326431 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 83/153] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:36 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:36.444433 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-65d5520e-816a-4b28-9976-e3bddceafb3a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:36.445057 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-65d5520e-816a-4b28-9976-e3bddceafb3a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:36.451274 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-65d5520e-816a-4b28-9976-e3bddceafb3a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:36.451811 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-65d5520e-816a-4b28-9976-e3bddceafb3a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:36.452256 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-65d5520e-816a-4b28-9976-e3bddceafb3a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:36.452943 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-65d5520e-816a-4b28-9976-e3bddceafb3a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:36.453374 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-65d5520e-816a-4b28-9976-e3bddceafb3a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:36.453792 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-65d5520e-816a-4b28-9976-e3bddceafb3a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:36.475699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9fbb7dde-77f0-482b-82ae-f7fbea1e6a86 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:36.477870 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9fbb7dde-77f0-482b-82ae-f7fbea1e6a86 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:36.485778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9fbb7dde-77f0-482b-82ae-f7fbea1e6a86 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:36.486473 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9fbb7dde-77f0-482b-82ae-f7fbea1e6a86 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:36.487002 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9fbb7dde-77f0-482b-82ae-f7fbea1e6a86 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:36.488013 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9fbb7dde-77f0-482b-82ae-f7fbea1e6a86 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:36.488586 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9fbb7dde-77f0-482b-82ae-f7fbea1e6a86 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:36.489103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9fbb7dde-77f0-482b-82ae-f7fbea1e6a86 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:36.593077 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-65d5520e-816a-4b28-9976-e3bddceafb3a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:36.601646 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-65d5520e-816a-4b28-9976-e3bddceafb3a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.162186 Sep 14 01:05:36.602221 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 71/154] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:36 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:36.633113 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9fbb7dde-77f0-482b-82ae-f7fbea1e6a86 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:36.641351 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9fbb7dde-77f0-482b-82ae-f7fbea1e6a86 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1321 microversion: 2.1 time: 0.171157 Sep 14 01:05:36.642235 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 84/155] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:36 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:36.807100 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-597032ca-4761-4008-90c9-687e80b63380 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:36.808197 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-597032ca-4761-4008-90c9-687e80b63380 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:36.814585 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-597032ca-4761-4008-90c9-687e80b63380 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:36.815079 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-597032ca-4761-4008-90c9-687e80b63380 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:36.815516 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-597032ca-4761-4008-90c9-687e80b63380 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:36.816297 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-597032ca-4761-4008-90c9-687e80b63380 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:36.816756 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-597032ca-4761-4008-90c9-687e80b63380 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:36.817477 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-597032ca-4761-4008-90c9-687e80b63380 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:36.980962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-597032ca-4761-4008-90c9-687e80b63380 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:36.992937 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-597032ca-4761-4008-90c9-687e80b63380 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 0.189332 Sep 14 01:05:37.004537 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 72/156] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:36 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:37.110392 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-067d047b-40ea-4b2b-93b1-2de97301f7fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:37.112185 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-067d047b-40ea-4b2b-93b1-2de97301f7fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:37.119906 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-067d047b-40ea-4b2b-93b1-2de97301f7fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:37.120559 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-067d047b-40ea-4b2b-93b1-2de97301f7fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:37.121162 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-067d047b-40ea-4b2b-93b1-2de97301f7fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:37.122228 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-067d047b-40ea-4b2b-93b1-2de97301f7fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:37.122833 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-067d047b-40ea-4b2b-93b1-2de97301f7fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:37.123401 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-067d047b-40ea-4b2b-93b1-2de97301f7fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:37.310766 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-067d047b-40ea-4b2b-93b1-2de97301f7fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:37.321565 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-067d047b-40ea-4b2b-93b1-2de97301f7fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1368 microversion: 2.1 time: 0.215045 Sep 14 01:05:37.322611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 85/157] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:37 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:37.355328 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4aede3e7-d342-4fb2-982e-7a7031427e17 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:37.355328 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4aede3e7-d342-4fb2-982e-7a7031427e17 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:37.358600 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4aede3e7-d342-4fb2-982e-7a7031427e17 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:37.359103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4aede3e7-d342-4fb2-982e-7a7031427e17 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:37.359698 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4aede3e7-d342-4fb2-982e-7a7031427e17 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:37.360406 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4aede3e7-d342-4fb2-982e-7a7031427e17 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:37.360970 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4aede3e7-d342-4fb2-982e-7a7031427e17 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:37.361395 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4aede3e7-d342-4fb2-982e-7a7031427e17 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:37.541814 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-42b8e7b8-9013-4c7c-baa0-a2515b1c51c6 req-23da4cce-f103-4211-bf3a-4ee840cdd4da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449d7479-aa1a-475f-baf9-ecee9f4a52f4", "name": "network-vif-plugged", "status": "completed", "tag": "9bbe2be7-ebc9-44fb-b5fb-4efec8957ccb"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:37.565281 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-42b8e7b8-9013-4c7c-baa0-a2515b1c51c6 req-23da4cce-f103-4211-bf3a-4ee840cdd4da service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:37.566036 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-42b8e7b8-9013-4c7c-baa0-a2515b1c51c6 req-23da4cce-f103-4211-bf3a-4ee840cdd4da service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:37.566835 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-42b8e7b8-9013-4c7c-baa0-a2515b1c51c6 req-23da4cce-f103-4211-bf3a-4ee840cdd4da service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:37.581462 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4aede3e7-d342-4fb2-982e-7a7031427e17 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:37.591571 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4aede3e7-d342-4fb2-982e-7a7031427e17 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:37.597147 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4aede3e7-d342-4fb2-982e-7a7031427e17 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:37.598306 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4aede3e7-d342-4fb2-982e-7a7031427e17 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1406 microversion: 2.20 time: 0.251424 Sep 14 01:05:37.599580 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 73/158] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:37 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1406 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:05:37.602252 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-42b8e7b8-9013-4c7c-baa0-a2515b1c51c6 req-23da4cce-f103-4211-bf3a-4ee840cdd4da service nova] Creating event network-vif-plugged:9bbe2be7-ebc9-44fb-b5fb-4efec8957ccb for instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 on hv-cinder-85752 Sep 14 01:05:37.608078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-42b8e7b8-9013-4c7c-baa0-a2515b1c51c6 req-23da4cce-f103-4211-bf3a-4ee840cdd4da service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069718 Sep 14 01:05:37.608784 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 86/159] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:05:37.624469 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2e9f41d1-e963-4451-95ab-6368b2c6c1f5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:37.625268 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2e9f41d1-e963-4451-95ab-6368b2c6c1f5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:37.632908 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2e9f41d1-e963-4451-95ab-6368b2c6c1f5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:37.633398 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2e9f41d1-e963-4451-95ab-6368b2c6c1f5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:37.634471 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2e9f41d1-e963-4451-95ab-6368b2c6c1f5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:37.635170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2e9f41d1-e963-4451-95ab-6368b2c6c1f5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:37.635666 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2e9f41d1-e963-4451-95ab-6368b2c6c1f5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:37.636288 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2e9f41d1-e963-4451-95ab-6368b2c6c1f5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:37.641488 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=100 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:37.666405 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-52ef8d37-67e2-4dc5-ad7f-80739edb49ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:37.668112 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-52ef8d37-67e2-4dc5-ad7f-80739edb49ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:37.675994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52ef8d37-67e2-4dc5-ad7f-80739edb49ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:37.677758 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52ef8d37-67e2-4dc5-ad7f-80739edb49ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:37.678304 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52ef8d37-67e2-4dc5-ad7f-80739edb49ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:37.679297 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52ef8d37-67e2-4dc5-ad7f-80739edb49ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:37.679921 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52ef8d37-67e2-4dc5-ad7f-80739edb49ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:37.680452 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52ef8d37-67e2-4dc5-ad7f-80739edb49ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:37.831801 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-2e9f41d1-e963-4451-95ab-6368b2c6c1f5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:37.843155 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2e9f41d1-e963-4451-95ab-6368b2c6c1f5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.221857 Sep 14 01:05:37.845159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 74/160] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:37 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:37.905439 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-52ef8d37-67e2-4dc5-ad7f-80739edb49ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:37.919264 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-52ef8d37-67e2-4dc5-ad7f-80739edb49ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1321 microversion: 2.1 time: 0.257849 Sep 14 01:05:37.920098 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 87/161] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:37 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:38.019470 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-00b0c186-87f1-4dcd-9502-bfef4570340f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:38.021047 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-00b0c186-87f1-4dcd-9502-bfef4570340f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:38.031674 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-00b0c186-87f1-4dcd-9502-bfef4570340f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:38.033692 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-00b0c186-87f1-4dcd-9502-bfef4570340f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:38.034490 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-00b0c186-87f1-4dcd-9502-bfef4570340f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:38.038843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-00b0c186-87f1-4dcd-9502-bfef4570340f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:38.040421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-00b0c186-87f1-4dcd-9502-bfef4570340f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:38.042639 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-00b0c186-87f1-4dcd-9502-bfef4570340f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:38.242947 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-00b0c186-87f1-4dcd-9502-bfef4570340f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:38.251237 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-00b0c186-87f1-4dcd-9502-bfef4570340f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 0.236636 Sep 14 01:05:38.262535 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 75/162] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:38 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:38.344125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b9e9f833-42ed-48ef-81ba-57b6159a11f5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:38.344865 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b9e9f833-42ed-48ef-81ba-57b6159a11f5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:38.350831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b9e9f833-42ed-48ef-81ba-57b6159a11f5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:38.351391 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b9e9f833-42ed-48ef-81ba-57b6159a11f5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:38.351868 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b9e9f833-42ed-48ef-81ba-57b6159a11f5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:38.352554 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b9e9f833-42ed-48ef-81ba-57b6159a11f5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:38.353092 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b9e9f833-42ed-48ef-81ba-57b6159a11f5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:38.353534 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b9e9f833-42ed-48ef-81ba-57b6159a11f5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:38.557382 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b9e9f833-42ed-48ef-81ba-57b6159a11f5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:38.566153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b9e9f833-42ed-48ef-81ba-57b6159a11f5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1368 microversion: 2.1 time: 0.225708 Sep 14 01:05:38.566851 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 88/163] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:38 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:38.623895 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8280cb76-19d6-4712-a323-c0e842d0b51f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:38.625085 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8280cb76-19d6-4712-a323-c0e842d0b51f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:38.643433 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8280cb76-19d6-4712-a323-c0e842d0b51f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:38.644033 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8280cb76-19d6-4712-a323-c0e842d0b51f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:38.644529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8280cb76-19d6-4712-a323-c0e842d0b51f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:38.646263 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8280cb76-19d6-4712-a323-c0e842d0b51f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:38.646954 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8280cb76-19d6-4712-a323-c0e842d0b51f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:38.647595 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8280cb76-19d6-4712-a323-c0e842d0b51f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:38.874131 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fa2424ac-01fe-46a0-88ee-042712a09051 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:38.874910 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fa2424ac-01fe-46a0-88ee-042712a09051 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:38.882699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa2424ac-01fe-46a0-88ee-042712a09051 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:38.883492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=2 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:38.885322 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa2424ac-01fe-46a0-88ee-042712a09051 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:38.887464 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa2424ac-01fe-46a0-88ee-042712a09051 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:38.888430 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa2424ac-01fe-46a0-88ee-042712a09051 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:38.889042 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa2424ac-01fe-46a0-88ee-042712a09051 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:38.889951 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fa2424ac-01fe-46a0-88ee-042712a09051 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:39.240986 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fa2424ac-01fe-46a0-88ee-042712a09051 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:39.248931 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fa2424ac-01fe-46a0-88ee-042712a09051 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.378925 Sep 14 01:05:39.264698 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 89/164] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:38 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:39.271251 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-cfcb3ed4-5ec6-4238-8e52-e8750b976992 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:39.272332 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-cfcb3ed4-5ec6-4238-8e52-e8750b976992 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:39.279757 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cfcb3ed4-5ec6-4238-8e52-e8750b976992 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:39.280252 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cfcb3ed4-5ec6-4238-8e52-e8750b976992 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:39.280687 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cfcb3ed4-5ec6-4238-8e52-e8750b976992 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:39.281378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cfcb3ed4-5ec6-4238-8e52-e8750b976992 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:39.282055 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cfcb3ed4-5ec6-4238-8e52-e8750b976992 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:39.282705 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cfcb3ed4-5ec6-4238-8e52-e8750b976992 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:39.362948 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8280cb76-19d6-4712-a323-c0e842d0b51f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:39.373085 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8280cb76-19d6-4712-a323-c0e842d0b51f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:39.375024 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8280cb76-19d6-4712-a323-c0e842d0b51f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:39.376622 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8280cb76-19d6-4712-a323-c0e842d0b51f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1406 microversion: 2.20 time: 0.756756 Sep 14 01:05:39.377883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 76/165] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:38 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1406 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:39.385958 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a68e1d7e-bbf7-413b-b4e0-4119b92332ee tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:39.386849 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a68e1d7e-bbf7-413b-b4e0-4119b92332ee tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:39.394467 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a68e1d7e-bbf7-413b-b4e0-4119b92332ee tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:39.395305 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a68e1d7e-bbf7-413b-b4e0-4119b92332ee tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:39.396577 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a68e1d7e-bbf7-413b-b4e0-4119b92332ee tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:39.397724 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a68e1d7e-bbf7-413b-b4e0-4119b92332ee tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:39.398487 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a68e1d7e-bbf7-413b-b4e0-4119b92332ee tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:39.399172 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a68e1d7e-bbf7-413b-b4e0-4119b92332ee tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:39.510094 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cfcb3ed4-5ec6-4238-8e52-e8750b976992 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:39.520800 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-cfcb3ed4-5ec6-4238-8e52-e8750b976992 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1321 microversion: 2.1 time: 0.253506 Sep 14 01:05:39.522473 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 90/166] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:39 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:39.592150 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-53d9cc07-79cc-42ba-bd63-eb1418bcfa53 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:39.592926 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-53d9cc07-79cc-42ba-bd63-eb1418bcfa53 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:39.603087 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53d9cc07-79cc-42ba-bd63-eb1418bcfa53 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:39.606237 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53d9cc07-79cc-42ba-bd63-eb1418bcfa53 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:39.606856 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53d9cc07-79cc-42ba-bd63-eb1418bcfa53 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:39.607803 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53d9cc07-79cc-42ba-bd63-eb1418bcfa53 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:39.608516 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53d9cc07-79cc-42ba-bd63-eb1418bcfa53 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:39.609057 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53d9cc07-79cc-42ba-bd63-eb1418bcfa53 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:39.629347 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a68e1d7e-bbf7-413b-b4e0-4119b92332ee tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:39.639535 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a68e1d7e-bbf7-413b-b4e0-4119b92332ee tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 0.260049 Sep 14 01:05:39.640162 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 77/167] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:39 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:39.646775 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-7e335e3b-34bd-4794-a080-406ef71f68be req-f9b295ba-936c-46ca-99b7-dae30345c131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f390b4d1-983e-4ea4-bb3f-e7e7e82a564a", "name": "network-vif-plugged", "status": "completed", "tag": "c55b96cb-5290-47cc-a378-c5a31536d115"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:39.666848 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-7e335e3b-34bd-4794-a080-406ef71f68be req-f9b295ba-936c-46ca-99b7-dae30345c131 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:39.667473 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-7e335e3b-34bd-4794-a080-406ef71f68be req-f9b295ba-936c-46ca-99b7-dae30345c131 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:39.668011 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-7e335e3b-34bd-4794-a080-406ef71f68be req-f9b295ba-936c-46ca-99b7-dae30345c131 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:39.687292 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-7e335e3b-34bd-4794-a080-406ef71f68be req-f9b295ba-936c-46ca-99b7-dae30345c131 service nova] Creating event network-vif-plugged:c55b96cb-5290-47cc-a378-c5a31536d115 for instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a on hv-cinder-85752 Sep 14 01:05:39.705009 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-7e335e3b-34bd-4794-a080-406ef71f68be req-f9b295ba-936c-46ca-99b7-dae30345c131 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061921 Sep 14 01:05:39.707738 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 78/168] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:05:39.819449 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-53d9cc07-79cc-42ba-bd63-eb1418bcfa53 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:39.828872 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-53d9cc07-79cc-42ba-bd63-eb1418bcfa53 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1368 microversion: 2.1 time: 0.240616 Sep 14 01:05:39.829970 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 91/169] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:39 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1368 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:40.279211 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d5846259-aae7-4077-9a38-dcde263fe5f1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:40.280083 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d5846259-aae7-4077-9a38-dcde263fe5f1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:40.287613 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d5846259-aae7-4077-9a38-dcde263fe5f1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:40.289772 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d5846259-aae7-4077-9a38-dcde263fe5f1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:40.290295 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d5846259-aae7-4077-9a38-dcde263fe5f1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:40.291920 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d5846259-aae7-4077-9a38-dcde263fe5f1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:40.292809 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d5846259-aae7-4077-9a38-dcde263fe5f1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:40.293502 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d5846259-aae7-4077-9a38-dcde263fe5f1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:40.408364 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b92ab616-c9fe-475f-8976-239a10735070 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:40.409746 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b92ab616-c9fe-475f-8976-239a10735070 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:40.417492 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b92ab616-c9fe-475f-8976-239a10735070 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:40.418611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b92ab616-c9fe-475f-8976-239a10735070 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:40.419390 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b92ab616-c9fe-475f-8976-239a10735070 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:40.421065 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b92ab616-c9fe-475f-8976-239a10735070 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:40.421722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b92ab616-c9fe-475f-8976-239a10735070 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:40.422244 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b92ab616-c9fe-475f-8976-239a10735070 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:40.506361 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d5846259-aae7-4077-9a38-dcde263fe5f1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:40.516964 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d5846259-aae7-4077-9a38-dcde263fe5f1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.242141 Sep 14 01:05:40.517998 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 79/170] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:40 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:40.547982 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-5b7055ec-211e-4224-9e41-e73b7ed12004 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:40.548794 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-5b7055ec-211e-4224-9e41-e73b7ed12004 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:40.570868 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5b7055ec-211e-4224-9e41-e73b7ed12004 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:40.572439 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5b7055ec-211e-4224-9e41-e73b7ed12004 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:40.573182 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5b7055ec-211e-4224-9e41-e73b7ed12004 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:40.577533 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5b7055ec-211e-4224-9e41-e73b7ed12004 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:40.578099 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5b7055ec-211e-4224-9e41-e73b7ed12004 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:40.578696 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5b7055ec-211e-4224-9e41-e73b7ed12004 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:40.640522 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b92ab616-c9fe-475f-8976-239a10735070 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:40.669465 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b92ab616-c9fe-475f-8976-239a10735070 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:40.677034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b92ab616-c9fe-475f-8976-239a10735070 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:40.681270 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b92ab616-c9fe-475f-8976-239a10735070 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1406 microversion: 2.20 time: 0.278151 Sep 14 01:05:40.683309 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 92/171] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:40 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:40.694125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e5c92fe0-590b-4ce8-9635-34640a127911 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:40.694735 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e5c92fe0-590b-4ce8-9635-34640a127911 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:40.712915 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e5c92fe0-590b-4ce8-9635-34640a127911 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:40.713441 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e5c92fe0-590b-4ce8-9635-34640a127911 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:40.713916 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e5c92fe0-590b-4ce8-9635-34640a127911 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:40.714659 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e5c92fe0-590b-4ce8-9635-34640a127911 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:40.715111 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e5c92fe0-590b-4ce8-9635-34640a127911 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:40.715524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e5c92fe0-590b-4ce8-9635-34640a127911 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:40.764928 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:40.966811 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e5c92fe0-590b-4ce8-9635-34640a127911 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:40.981914 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e5c92fe0-590b-4ce8-9635-34640a127911 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 0.297338 Sep 14 01:05:40.985279 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 93/172] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:40 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:40.997653 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5cf6ffb3-1a32-4f63-a791-a7f7969b183e tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:40.999492 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5cf6ffb3-1a32-4f63-a791-a7f7969b183e tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:41.017736 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5cf6ffb3-1a32-4f63-a791-a7f7969b183e tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:41.018752 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5cf6ffb3-1a32-4f63-a791-a7f7969b183e tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:41.019349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5cf6ffb3-1a32-4f63-a791-a7f7969b183e tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:41.020314 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5cf6ffb3-1a32-4f63-a791-a7f7969b183e tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:41.021936 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5cf6ffb3-1a32-4f63-a791-a7f7969b183e tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:41.023346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5cf6ffb3-1a32-4f63-a791-a7f7969b183e tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:41.056707 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-5b7055ec-211e-4224-9e41-e73b7ed12004 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:41.067462 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-5b7055ec-211e-4224-9e41-e73b7ed12004 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1321 microversion: 2.1 time: 0.524171 Sep 14 01:05:41.068722 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 80/173] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:40 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1321 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:41.315143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5cf6ffb3-1a32-4f63-a791-a7f7969b183e tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:41.334157 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5cf6ffb3-1a32-4f63-a791-a7f7969b183e tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1368 microversion: 2.1 time: 0.347613 Sep 14 01:05:41.341316 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 94/174] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:40 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1368 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:41.541369 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-5cfe45ef-9312-4137-b18a-6f7cc5bbc33e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:41.541994 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-5cfe45ef-9312-4137-b18a-6f7cc5bbc33e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:41.549006 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5cfe45ef-9312-4137-b18a-6f7cc5bbc33e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:41.549748 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5cfe45ef-9312-4137-b18a-6f7cc5bbc33e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:41.550389 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5cfe45ef-9312-4137-b18a-6f7cc5bbc33e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:41.551274 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5cfe45ef-9312-4137-b18a-6f7cc5bbc33e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:41.553181 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5cfe45ef-9312-4137-b18a-6f7cc5bbc33e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:41.554134 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5cfe45ef-9312-4137-b18a-6f7cc5bbc33e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:41.712170 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4a3bf4a7-568b-4a1d-87e2-e32b5372b694 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:41.712780 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4a3bf4a7-568b-4a1d-87e2-e32b5372b694 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:41.715701 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:41.724323 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-5cfe45ef-9312-4137-b18a-6f7cc5bbc33e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:41.726544 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4a3bf4a7-568b-4a1d-87e2-e32b5372b694 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:41.727109 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4a3bf4a7-568b-4a1d-87e2-e32b5372b694 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:41.727639 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4a3bf4a7-568b-4a1d-87e2-e32b5372b694 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:41.728601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4a3bf4a7-568b-4a1d-87e2-e32b5372b694 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:41.729229 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4a3bf4a7-568b-4a1d-87e2-e32b5372b694 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:41.729807 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4a3bf4a7-568b-4a1d-87e2-e32b5372b694 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:41.732120 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-5cfe45ef-9312-4137-b18a-6f7cc5bbc33e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.195760 Sep 14 01:05:41.734269 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 81/175] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:41 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:41.742361 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-5a4eeda7-84a6-478b-b976-db7caa895ef6 req-defe8050-18bd-4e65-81f4-d355972e1c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02da4a4-64f7-47c0-a48f-9cdb71f30df9", "name": "network-vif-plugged", "status": "completed", "tag": "61ac6a9d-d543-4896-a237-b3287bcd2644"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:41.759649 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-5a4eeda7-84a6-478b-b976-db7caa895ef6 req-defe8050-18bd-4e65-81f4-d355972e1c0a service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:41.760173 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-5a4eeda7-84a6-478b-b976-db7caa895ef6 req-defe8050-18bd-4e65-81f4-d355972e1c0a service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:41.761816 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-5a4eeda7-84a6-478b-b976-db7caa895ef6 req-defe8050-18bd-4e65-81f4-d355972e1c0a service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:41.775928 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-5a4eeda7-84a6-478b-b976-db7caa895ef6 req-defe8050-18bd-4e65-81f4-d355972e1c0a service nova] Creating event network-vif-plugged:61ac6a9d-d543-4896-a237-b3287bcd2644 for instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 on hv-cinder-85752 Sep 14 01:05:41.781745 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-5a4eeda7-84a6-478b-b976-db7caa895ef6 req-defe8050-18bd-4e65-81f4-d355972e1c0a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046170 Sep 14 01:05:41.782535 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 82/176] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:05:41.891035 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4a3bf4a7-568b-4a1d-87e2-e32b5372b694 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:41.901601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4a3bf4a7-568b-4a1d-87e2-e32b5372b694 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:41.903610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4a3bf4a7-568b-4a1d-87e2-e32b5372b694 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:41.904831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4a3bf4a7-568b-4a1d-87e2-e32b5372b694 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1406 microversion: 2.20 time: 0.199052 Sep 14 01:05:41.905498 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 95/177] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:41 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:05:42.010404 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-de6f5548-f479-4f3d-b796-ef4ae9986af1 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:42.011299 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-de6f5548-f479-4f3d-b796-ef4ae9986af1 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:42.017793 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-de6f5548-f479-4f3d-b796-ef4ae9986af1 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:42.018502 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-de6f5548-f479-4f3d-b796-ef4ae9986af1 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:42.018934 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-de6f5548-f479-4f3d-b796-ef4ae9986af1 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:42.019709 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-de6f5548-f479-4f3d-b796-ef4ae9986af1 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:42.020153 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-de6f5548-f479-4f3d-b796-ef4ae9986af1 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:42.021512 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-de6f5548-f479-4f3d-b796-ef4ae9986af1 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:42.091167 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d98e5b30-09cc-40b5-b625-5465a572308c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:42.091881 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d98e5b30-09cc-40b5-b625-5465a572308c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:42.101388 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d98e5b30-09cc-40b5-b625-5465a572308c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:42.102437 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d98e5b30-09cc-40b5-b625-5465a572308c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:42.104339 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d98e5b30-09cc-40b5-b625-5465a572308c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:42.105715 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d98e5b30-09cc-40b5-b625-5465a572308c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:42.107736 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d98e5b30-09cc-40b5-b625-5465a572308c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:42.108667 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d98e5b30-09cc-40b5-b625-5465a572308c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:42.221262 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-de6f5548-f479-4f3d-b796-ef4ae9986af1 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:42.231043 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-de6f5548-f479-4f3d-b796-ef4ae9986af1 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 0.227438 Sep 14 01:05:42.232178 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 83/178] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:42 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:42.346932 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d98e5b30-09cc-40b5-b625-5465a572308c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:42.358515 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d98e5b30-09cc-40b5-b625-5465a572308c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1515 microversion: 2.1 time: 0.270044 Sep 14 01:05:42.360447 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 96/179] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:42 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1515 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:42.366543 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ef6cfbea-8c5f-48dd-8be3-fa77e88c53be tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:42.367965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ef6cfbea-8c5f-48dd-8be3-fa77e88c53be tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:42.376935 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ef6cfbea-8c5f-48dd-8be3-fa77e88c53be tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:42.378696 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ef6cfbea-8c5f-48dd-8be3-fa77e88c53be tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:42.379688 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ef6cfbea-8c5f-48dd-8be3-fa77e88c53be tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:42.382326 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ef6cfbea-8c5f-48dd-8be3-fa77e88c53be tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:42.382815 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ef6cfbea-8c5f-48dd-8be3-fa77e88c53be tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:42.383246 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ef6cfbea-8c5f-48dd-8be3-fa77e88c53be tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:42.384673 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7912ce5f-f8e4-4cb8-9de1-c88f06c7cff2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:42.389965 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7912ce5f-f8e4-4cb8-9de1-c88f06c7cff2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:42.404310 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7912ce5f-f8e4-4cb8-9de1-c88f06c7cff2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:42.404851 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7912ce5f-f8e4-4cb8-9de1-c88f06c7cff2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:42.406542 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7912ce5f-f8e4-4cb8-9de1-c88f06c7cff2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:42.407380 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7912ce5f-f8e4-4cb8-9de1-c88f06c7cff2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:42.409529 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7912ce5f-f8e4-4cb8-9de1-c88f06c7cff2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:42.409959 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7912ce5f-f8e4-4cb8-9de1-c88f06c7cff2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:42.528137 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-7912ce5f-f8e4-4cb8-9de1-c88f06c7cff2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lazy-loading 'flavor' on Instance uuid 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:05:42.584940 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ef6cfbea-8c5f-48dd-8be3-fa77e88c53be tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:42.594926 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ef6cfbea-8c5f-48dd-8be3-fa77e88c53be tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1368 microversion: 2.1 time: 0.235007 Sep 14 01:05:42.595989 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 84/180] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:42 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:42.672548 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7912ce5f-f8e4-4cb8-9de1-c88f06c7cff2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "POST /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa/action" status: 200 len: 32 microversion: 2.1 time: 0.291824 Sep 14 01:05:42.673521 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 97/181] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 01:05:42 2022] POST /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa/action => generated 32 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 01:05:42.683916 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-1049726a-ce32-452f-983d-0579535acbb4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:42.684692 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-1049726a-ce32-452f-983d-0579535acbb4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:42.691426 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1049726a-ce32-452f-983d-0579535acbb4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:42.691948 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1049726a-ce32-452f-983d-0579535acbb4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:42.693077 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1049726a-ce32-452f-983d-0579535acbb4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:42.693974 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1049726a-ce32-452f-983d-0579535acbb4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:42.694437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1049726a-ce32-452f-983d-0579535acbb4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:42.694858 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1049726a-ce32-452f-983d-0579535acbb4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:42.757656 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d9ef7ad6-1d20-47ee-818a-c8340ae98e1d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:42.758345 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d9ef7ad6-1d20-47ee-818a-c8340ae98e1d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:42.769966 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d9ef7ad6-1d20-47ee-818a-c8340ae98e1d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:42.771049 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d9ef7ad6-1d20-47ee-818a-c8340ae98e1d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:42.773478 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d9ef7ad6-1d20-47ee-818a-c8340ae98e1d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:42.778119 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d9ef7ad6-1d20-47ee-818a-c8340ae98e1d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:42.778599 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d9ef7ad6-1d20-47ee-818a-c8340ae98e1d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:42.780408 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d9ef7ad6-1d20-47ee-818a-c8340ae98e1d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:42.916042 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-1049726a-ce32-452f-983d-0579535acbb4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:42.925896 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-1049726a-ce32-452f-983d-0579535acbb4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.245984 Sep 14 01:05:42.927315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 85/182] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:42 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:42.933437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-bf6cc93c-42b1-455c-96d3-ebc44fa9d4bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:42.934536 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-bf6cc93c-42b1-455c-96d3-ebc44fa9d4bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:42.945238 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bf6cc93c-42b1-455c-96d3-ebc44fa9d4bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:42.946252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bf6cc93c-42b1-455c-96d3-ebc44fa9d4bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:42.946926 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bf6cc93c-42b1-455c-96d3-ebc44fa9d4bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:42.947864 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bf6cc93c-42b1-455c-96d3-ebc44fa9d4bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:42.948833 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bf6cc93c-42b1-455c-96d3-ebc44fa9d4bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:42.949402 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bf6cc93c-42b1-455c-96d3-ebc44fa9d4bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:43.048885 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d9ef7ad6-1d20-47ee-818a-c8340ae98e1d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:43.060859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d9ef7ad6-1d20-47ee-818a-c8340ae98e1d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.308320 Sep 14 01:05:43.062038 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 98/183] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:42 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:43.122026 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bf6cc93c-42b1-455c-96d3-ebc44fa9d4bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:43.130096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bf6cc93c-42b1-455c-96d3-ebc44fa9d4bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:43.131549 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bf6cc93c-42b1-455c-96d3-ebc44fa9d4bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:43.132682 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-bf6cc93c-42b1-455c-96d3-ebc44fa9d4bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1406 microversion: 2.20 time: 0.204148 Sep 14 01:05:43.133244 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 86/184] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:42 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:43.255178 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b582ad28-45cc-4f20-83c6-9135472ab50f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:43.256011 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b582ad28-45cc-4f20-83c6-9135472ab50f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:43.263494 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b582ad28-45cc-4f20-83c6-9135472ab50f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:43.264082 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b582ad28-45cc-4f20-83c6-9135472ab50f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:43.264776 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b582ad28-45cc-4f20-83c6-9135472ab50f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:43.265465 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b582ad28-45cc-4f20-83c6-9135472ab50f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:43.265915 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b582ad28-45cc-4f20-83c6-9135472ab50f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:43.266340 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b582ad28-45cc-4f20-83c6-9135472ab50f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:43.424584 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b582ad28-45cc-4f20-83c6-9135472ab50f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:43.433795 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b582ad28-45cc-4f20-83c6-9135472ab50f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1314 microversion: 2.1 time: 0.183473 Sep 14 01:05:43.434377 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 99/185] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:43 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:43.619856 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-afe8962c-d5b4-4bb1-8082-b3dd048d6fdb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:43.620491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-afe8962c-d5b4-4bb1-8082-b3dd048d6fdb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:43.627129 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-afe8962c-d5b4-4bb1-8082-b3dd048d6fdb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:43.627920 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-afe8962c-d5b4-4bb1-8082-b3dd048d6fdb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:43.628158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-afe8962c-d5b4-4bb1-8082-b3dd048d6fdb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:43.628844 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-afe8962c-d5b4-4bb1-8082-b3dd048d6fdb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:43.629297 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-afe8962c-d5b4-4bb1-8082-b3dd048d6fdb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:43.629784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-afe8962c-d5b4-4bb1-8082-b3dd048d6fdb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:43.794844 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-afe8962c-d5b4-4bb1-8082-b3dd048d6fdb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:43.803525 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-afe8962c-d5b4-4bb1-8082-b3dd048d6fdb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1368 microversion: 2.1 time: 0.188672 Sep 14 01:05:43.804447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 87/186] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:43 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:43.952645 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4e5dbbb3-3e2e-47a9-8fb5-618a21eb781e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:43.953304 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4e5dbbb3-3e2e-47a9-8fb5-618a21eb781e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:43.960698 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4e5dbbb3-3e2e-47a9-8fb5-618a21eb781e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:43.961255 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4e5dbbb3-3e2e-47a9-8fb5-618a21eb781e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:43.961787 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4e5dbbb3-3e2e-47a9-8fb5-618a21eb781e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:43.962539 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4e5dbbb3-3e2e-47a9-8fb5-618a21eb781e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:43.963161 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4e5dbbb3-3e2e-47a9-8fb5-618a21eb781e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:43.964048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4e5dbbb3-3e2e-47a9-8fb5-618a21eb781e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:44.086576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-00ac777c-8432-4ab6-80d3-bd77f52bb503 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:44.088006 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-00ac777c-8432-4ab6-80d3-bd77f52bb503 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:44.094417 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-00ac777c-8432-4ab6-80d3-bd77f52bb503 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:44.095152 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-00ac777c-8432-4ab6-80d3-bd77f52bb503 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:44.095810 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-00ac777c-8432-4ab6-80d3-bd77f52bb503 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:44.096706 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-00ac777c-8432-4ab6-80d3-bd77f52bb503 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:44.097355 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-00ac777c-8432-4ab6-80d3-bd77f52bb503 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:44.098078 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-00ac777c-8432-4ab6-80d3-bd77f52bb503 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:44.102960 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4e5dbbb3-3e2e-47a9-8fb5-618a21eb781e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:44.111599 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4e5dbbb3-3e2e-47a9-8fb5-618a21eb781e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.163277 Sep 14 01:05:44.112191 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 100/187] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:43 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:44.161331 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-091d322e-cc87-4d97-a6ef-8387c7f72f03 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:44.162672 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-091d322e-cc87-4d97-a6ef-8387c7f72f03 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:44.171220 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-091d322e-cc87-4d97-a6ef-8387c7f72f03 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:44.171815 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-091d322e-cc87-4d97-a6ef-8387c7f72f03 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:44.172321 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-091d322e-cc87-4d97-a6ef-8387c7f72f03 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:44.173098 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-091d322e-cc87-4d97-a6ef-8387c7f72f03 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:44.173634 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-091d322e-cc87-4d97-a6ef-8387c7f72f03 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:44.174148 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-091d322e-cc87-4d97-a6ef-8387c7f72f03 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:44.401838 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-091d322e-cc87-4d97-a6ef-8387c7f72f03 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:44.417240 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-091d322e-cc87-4d97-a6ef-8387c7f72f03 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:44.419692 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-091d322e-cc87-4d97-a6ef-8387c7f72f03 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:44.421866 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-091d322e-cc87-4d97-a6ef-8387c7f72f03 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1406 microversion: 2.20 time: 0.266227 Sep 14 01:05:44.422966 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 101/188] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:44 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:44.435137 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-00ac777c-8432-4ab6-80d3-bd77f52bb503 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:44.449067 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-00ac777c-8432-4ab6-80d3-bd77f52bb503 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.367165 Sep 14 01:05:44.450299 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 88/189] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:44 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:44.470174 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-addf11c6-d797-48a4-8433-4b00476436b8 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:44.471033 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-addf11c6-d797-48a4-8433-4b00476436b8 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:44.481044 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-addf11c6-d797-48a4-8433-4b00476436b8 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:44.481533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-addf11c6-d797-48a4-8433-4b00476436b8 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:44.482021 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-addf11c6-d797-48a4-8433-4b00476436b8 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:44.482826 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-addf11c6-d797-48a4-8433-4b00476436b8 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:44.483350 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-addf11c6-d797-48a4-8433-4b00476436b8 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:44.489480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-addf11c6-d797-48a4-8433-4b00476436b8 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:44.661548 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-addf11c6-d797-48a4-8433-4b00476436b8 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:44.669793 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-addf11c6-d797-48a4-8433-4b00476436b8 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1501 microversion: 2.1 time: 0.204540 Sep 14 01:05:44.679587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 102/190] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:44 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1501 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:44.826356 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-cb2f9c67-8dd5-44cf-ad06-10fcd5a12ee9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:44.826969 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-cb2f9c67-8dd5-44cf-ad06-10fcd5a12ee9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:44.834409 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cb2f9c67-8dd5-44cf-ad06-10fcd5a12ee9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:44.834893 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cb2f9c67-8dd5-44cf-ad06-10fcd5a12ee9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:44.835607 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cb2f9c67-8dd5-44cf-ad06-10fcd5a12ee9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:44.837275 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cb2f9c67-8dd5-44cf-ad06-10fcd5a12ee9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:44.838040 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cb2f9c67-8dd5-44cf-ad06-10fcd5a12ee9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:44.838840 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cb2f9c67-8dd5-44cf-ad06-10fcd5a12ee9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:45.134860 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-be38d70f-290f-45cf-a120-dc84532a81be tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:45.135449 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-be38d70f-290f-45cf-a120-dc84532a81be tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:45.147825 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be38d70f-290f-45cf-a120-dc84532a81be tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:45.148627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be38d70f-290f-45cf-a120-dc84532a81be tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:45.149516 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be38d70f-290f-45cf-a120-dc84532a81be tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:45.163483 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be38d70f-290f-45cf-a120-dc84532a81be tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:45.168108 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be38d70f-290f-45cf-a120-dc84532a81be tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:45.168911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be38d70f-290f-45cf-a120-dc84532a81be tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:45.220545 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-cb2f9c67-8dd5-44cf-ad06-10fcd5a12ee9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:45.234937 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-cb2f9c67-8dd5-44cf-ad06-10fcd5a12ee9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1368 microversion: 2.1 time: 0.412467 Sep 14 01:05:45.238131 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 89/191] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:44 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1368 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:45.453824 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-bde1ce33-9ca2-4e9d-92b5-3e30202237da tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:45.454879 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-bde1ce33-9ca2-4e9d-92b5-3e30202237da tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:45.462342 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bde1ce33-9ca2-4e9d-92b5-3e30202237da tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:45.463117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bde1ce33-9ca2-4e9d-92b5-3e30202237da tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:45.463671 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bde1ce33-9ca2-4e9d-92b5-3e30202237da tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:45.464604 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bde1ce33-9ca2-4e9d-92b5-3e30202237da tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:45.465283 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bde1ce33-9ca2-4e9d-92b5-3e30202237da tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:45.465945 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bde1ce33-9ca2-4e9d-92b5-3e30202237da tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:45.484619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-be38d70f-290f-45cf-a120-dc84532a81be tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:45.498592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-be38d70f-290f-45cf-a120-dc84532a81be tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.367757 Sep 14 01:05:45.499935 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 103/192] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:45 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:45.516446 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-70cda98a-4b17-4a61-bda6-0b41116f4ce8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:45.517130 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-70cda98a-4b17-4a61-bda6-0b41116f4ce8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:45.523742 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70cda98a-4b17-4a61-bda6-0b41116f4ce8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:45.524463 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70cda98a-4b17-4a61-bda6-0b41116f4ce8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:45.525121 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70cda98a-4b17-4a61-bda6-0b41116f4ce8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:45.525993 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70cda98a-4b17-4a61-bda6-0b41116f4ce8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:45.526445 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70cda98a-4b17-4a61-bda6-0b41116f4ce8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:45.527072 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70cda98a-4b17-4a61-bda6-0b41116f4ce8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:45.669453 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bde1ce33-9ca2-4e9d-92b5-3e30202237da tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:45.687261 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bde1ce33-9ca2-4e9d-92b5-3e30202237da tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:45.690143 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bde1ce33-9ca2-4e9d-92b5-3e30202237da tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:45.691515 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-bde1ce33-9ca2-4e9d-92b5-3e30202237da tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1406 microversion: 2.20 time: 0.242141 Sep 14 01:05:45.709361 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 90/193] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:45 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:05:45.740452 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-70cda98a-4b17-4a61-bda6-0b41116f4ce8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:45.750651 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-70cda98a-4b17-4a61-bda6-0b41116f4ce8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.249283 Sep 14 01:05:45.758492 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 104/194] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:45 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:46.261302 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-15ae2f51-9808-48bb-9244-e2482936096a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4deb2fae-6cd8-4dc0-a084-ba8aa49fc653"}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:46.264080 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6ab008a4-fbbe-4d5f-a7a8-f8ae6cf53049 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:46.264846 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-15ae2f51-9808-48bb-9244-e2482936096a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:46.265662 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6ab008a4-fbbe-4d5f-a7a8-f8ae6cf53049 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:46.271240 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-15ae2f51-9808-48bb-9244-e2482936096a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:46.271870 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-15ae2f51-9808-48bb-9244-e2482936096a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:46.272781 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-15ae2f51-9808-48bb-9244-e2482936096a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:46.273264 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ab008a4-fbbe-4d5f-a7a8-f8ae6cf53049 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:46.273972 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-15ae2f51-9808-48bb-9244-e2482936096a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:46.277687 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ab008a4-fbbe-4d5f-a7a8-f8ae6cf53049 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:46.279351 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ab008a4-fbbe-4d5f-a7a8-f8ae6cf53049 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:46.280560 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ab008a4-fbbe-4d5f-a7a8-f8ae6cf53049 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:46.281708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-15ae2f51-9808-48bb-9244-e2482936096a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:46.282461 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-15ae2f51-9808-48bb-9244-e2482936096a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:46.284533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ab008a4-fbbe-4d5f-a7a8-f8ae6cf53049 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:46.288160 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ab008a4-fbbe-4d5f-a7a8-f8ae6cf53049 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:46.541641 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6ab008a4-fbbe-4d5f-a7a8-f8ae6cf53049 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:46.550829 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6ab008a4-fbbe-4d5f-a7a8-f8ae6cf53049 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1368 microversion: 2.1 time: 0.291226 Sep 14 01:05:46.552630 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 105/195] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:46 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1368 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:46.568400 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-eb3301ba-9c1c-445a-b688-f37953208490 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:46.569266 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-eb3301ba-9c1c-445a-b688-f37953208490 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:46.578158 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eb3301ba-9c1c-445a-b688-f37953208490 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:46.578902 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eb3301ba-9c1c-445a-b688-f37953208490 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:46.579773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eb3301ba-9c1c-445a-b688-f37953208490 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:46.580648 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eb3301ba-9c1c-445a-b688-f37953208490 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:46.581248 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eb3301ba-9c1c-445a-b688-f37953208490 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:46.581935 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eb3301ba-9c1c-445a-b688-f37953208490 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:46.744425 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-eb3301ba-9c1c-445a-b688-f37953208490 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:46.753729 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-eb3301ba-9c1c-445a-b688-f37953208490 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.199684 Sep 14 01:05:46.768238 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 106/196] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:46 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:46.776741 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ff289946-b45d-40d0-bc76-6d7552af51bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:46.777649 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ff289946-b45d-40d0-bc76-6d7552af51bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:46.784775 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff289946-b45d-40d0-bc76-6d7552af51bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:46.785643 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff289946-b45d-40d0-bc76-6d7552af51bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:46.786346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff289946-b45d-40d0-bc76-6d7552af51bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:46.787264 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff289946-b45d-40d0-bc76-6d7552af51bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:46.787832 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff289946-b45d-40d0-bc76-6d7552af51bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:46.788353 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ff289946-b45d-40d0-bc76-6d7552af51bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:46.942778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ff289946-b45d-40d0-bc76-6d7552af51bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:46.952068 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ff289946-b45d-40d0-bc76-6d7552af51bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:46.953842 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ff289946-b45d-40d0-bc76-6d7552af51bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:46.955189 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ff289946-b45d-40d0-bc76-6d7552af51bc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1406 microversion: 2.20 time: 0.185790 Sep 14 01:05:46.956658 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 107/197] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:46 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:46.963083 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-28070c2f-df44-4722-99a7-a6156f1a2897 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:46.964066 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-28070c2f-df44-4722-99a7-a6156f1a2897 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:46.972352 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28070c2f-df44-4722-99a7-a6156f1a2897 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:46.974134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28070c2f-df44-4722-99a7-a6156f1a2897 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:46.974868 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28070c2f-df44-4722-99a7-a6156f1a2897 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:46.975945 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28070c2f-df44-4722-99a7-a6156f1a2897 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:46.976662 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28070c2f-df44-4722-99a7-a6156f1a2897 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:46.977302 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28070c2f-df44-4722-99a7-a6156f1a2897 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:46.982519 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:47.174483 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-28070c2f-df44-4722-99a7-a6156f1a2897 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:47.182563 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-28070c2f-df44-4722-99a7-a6156f1a2897 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.223927 Sep 14 01:05:47.207412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 108/198] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:46 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:47.213364 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-1ceab06d-e100-4d76-9c09-feb266755e17 req-b7cbb35f-7757-4482-8913-bc7338bf9608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e701782-aa36-44dd-be23-a59054d8cb32", "name": "network-vif-plugged", "status": "completed", "tag": "620985b6-d85e-4dfc-884a-1a64043ee00d"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:47.223529 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-1ceab06d-e100-4d76-9c09-feb266755e17 req-b7cbb35f-7757-4482-8913-bc7338bf9608 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:47.223965 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-1ceab06d-e100-4d76-9c09-feb266755e17 req-b7cbb35f-7757-4482-8913-bc7338bf9608 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:47.224394 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-1ceab06d-e100-4d76-9c09-feb266755e17 req-b7cbb35f-7757-4482-8913-bc7338bf9608 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:47.235986 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-1ceab06d-e100-4d76-9c09-feb266755e17 req-b7cbb35f-7757-4482-8913-bc7338bf9608 service nova] Creating event network-vif-plugged:620985b6-d85e-4dfc-884a-1a64043ee00d for instance 5e701782-aa36-44dd-be23-a59054d8cb32 on hv-cinder-85752 Sep 14 01:05:47.241404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-1ceab06d-e100-4d76-9c09-feb266755e17 req-b7cbb35f-7757-4482-8913-bc7338bf9608 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032001 Sep 14 01:05:47.242003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 109/199] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:05:47.576532 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b02e99e4-ca5f-4b6d-8826-3dfd068a8ec1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:47.578984 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b02e99e4-ca5f-4b6d-8826-3dfd068a8ec1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:47.592157 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b02e99e4-ca5f-4b6d-8826-3dfd068a8ec1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:47.592735 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b02e99e4-ca5f-4b6d-8826-3dfd068a8ec1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:47.593357 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b02e99e4-ca5f-4b6d-8826-3dfd068a8ec1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:47.594072 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b02e99e4-ca5f-4b6d-8826-3dfd068a8ec1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:47.595311 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b02e99e4-ca5f-4b6d-8826-3dfd068a8ec1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:47.595787 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b02e99e4-ca5f-4b6d-8826-3dfd068a8ec1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:47.793335 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b02e99e4-ca5f-4b6d-8826-3dfd068a8ec1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:47.805216 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b02e99e4-ca5f-4b6d-8826-3dfd068a8ec1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1558 microversion: 2.1 time: 0.232671 Sep 14 01:05:47.805216 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 110/200] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:47 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1558 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:47.809983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-044a84a0-8e0a-46bd-afba-ac5ea50455ee tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:47.810537 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-044a84a0-8e0a-46bd-afba-ac5ea50455ee tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:47.816569 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-044a84a0-8e0a-46bd-afba-ac5ea50455ee tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:47.819268 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-044a84a0-8e0a-46bd-afba-ac5ea50455ee tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:47.820902 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-044a84a0-8e0a-46bd-afba-ac5ea50455ee tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:47.822620 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-044a84a0-8e0a-46bd-afba-ac5ea50455ee tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:47.823198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-044a84a0-8e0a-46bd-afba-ac5ea50455ee tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:47.823754 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-044a84a0-8e0a-46bd-afba-ac5ea50455ee tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:48.021709 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-044a84a0-8e0a-46bd-afba-ac5ea50455ee tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:48.031594 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-044a84a0-8e0a-46bd-afba-ac5ea50455ee tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.225887 Sep 14 01:05:48.032330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 111/201] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:47 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:48.038568 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3bad08be-0750-40ae-96f2-3af527cce605 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:48.039282 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3bad08be-0750-40ae-96f2-3af527cce605 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:48.045822 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3bad08be-0750-40ae-96f2-3af527cce605 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:48.046314 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3bad08be-0750-40ae-96f2-3af527cce605 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:48.046752 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3bad08be-0750-40ae-96f2-3af527cce605 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:48.047451 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3bad08be-0750-40ae-96f2-3af527cce605 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:48.048285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3bad08be-0750-40ae-96f2-3af527cce605 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:48.048679 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3bad08be-0750-40ae-96f2-3af527cce605 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:48.164345 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3bad08be-0750-40ae-96f2-3af527cce605 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130170 Sep 14 01:05:48.165310 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 112/202] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Sep 14 01:05:48 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:05:48.170920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1223e2c9-3ddb-4372-b76c-ef03350b079c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:48.171505 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1223e2c9-3ddb-4372-b76c-ef03350b079c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:48.200494 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1223e2c9-3ddb-4372-b76c-ef03350b079c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:48.200996 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1223e2c9-3ddb-4372-b76c-ef03350b079c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:48.201430 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1223e2c9-3ddb-4372-b76c-ef03350b079c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:48.202820 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1223e2c9-3ddb-4372-b76c-ef03350b079c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:48.203284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1223e2c9-3ddb-4372-b76c-ef03350b079c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:48.204255 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1223e2c9-3ddb-4372-b76c-ef03350b079c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:48.452641 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1223e2c9-3ddb-4372-b76c-ef03350b079c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:48.468105 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1223e2c9-3ddb-4372-b76c-ef03350b079c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:48.477842 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1223e2c9-3ddb-4372-b76c-ef03350b079c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:48.479319 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1223e2c9-3ddb-4372-b76c-ef03350b079c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1406 microversion: 2.20 time: 0.312654 Sep 14 01:05:48.480276 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 113/203] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:48 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:48.485084 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-99b49a52-0bf6-46c7-821e-0f9f98af84e3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:48.485770 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-99b49a52-0bf6-46c7-821e-0f9f98af84e3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:48.492755 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99b49a52-0bf6-46c7-821e-0f9f98af84e3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:48.493514 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99b49a52-0bf6-46c7-821e-0f9f98af84e3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:48.494177 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99b49a52-0bf6-46c7-821e-0f9f98af84e3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:48.495162 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99b49a52-0bf6-46c7-821e-0f9f98af84e3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:48.495854 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99b49a52-0bf6-46c7-821e-0f9f98af84e3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:48.496489 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99b49a52-0bf6-46c7-821e-0f9f98af84e3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:48.666028 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-99b49a52-0bf6-46c7-821e-0f9f98af84e3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:48.675833 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-99b49a52-0bf6-46c7-821e-0f9f98af84e3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.194238 Sep 14 01:05:48.677065 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 114/204] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:48 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:49.056750 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5c07e9b2-3d18-46e0-aa97-d074f0380269 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:49.057413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5c07e9b2-3d18-46e0-aa97-d074f0380269 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:49.069296 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5c07e9b2-3d18-46e0-aa97-d074f0380269 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:49.069793 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5c07e9b2-3d18-46e0-aa97-d074f0380269 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:49.070233 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5c07e9b2-3d18-46e0-aa97-d074f0380269 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:49.070929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5c07e9b2-3d18-46e0-aa97-d074f0380269 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:49.071381 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5c07e9b2-3d18-46e0-aa97-d074f0380269 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:49.071826 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5c07e9b2-3d18-46e0-aa97-d074f0380269 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:49.201695 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:05:49.411264 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5c07e9b2-3d18-46e0-aa97-d074f0380269 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:49.424927 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5c07e9b2-3d18-46e0-aa97-d074f0380269 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.372119 Sep 14 01:05:49.429263 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 115/205] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:49 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:49.434731 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-15ae2f51-9808-48bb-9244-e2482936096a tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "POST /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.179656 Sep 14 01:05:49.435363 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 91/206] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 01:05:46 2022] POST /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4/os-volume_attachments => generated 194 bytes in 3181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:05:49.511614 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c074a571-bf10-42bc-9ec4-26e02cd1c920 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:49.512405 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c074a571-bf10-42bc-9ec4-26e02cd1c920 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:49.519580 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c074a571-bf10-42bc-9ec4-26e02cd1c920 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:49.520452 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c074a571-bf10-42bc-9ec4-26e02cd1c920 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:49.521923 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c074a571-bf10-42bc-9ec4-26e02cd1c920 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:49.522818 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c074a571-bf10-42bc-9ec4-26e02cd1c920 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:49.523429 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c074a571-bf10-42bc-9ec4-26e02cd1c920 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:49.524166 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c074a571-bf10-42bc-9ec4-26e02cd1c920 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:49.709713 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-f6395d02-b4de-4505-8d7f-848476c09077 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:49.711266 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-f6395d02-b4de-4505-8d7f-848476c09077 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:49.723344 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c074a571-bf10-42bc-9ec4-26e02cd1c920 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:49.751610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c074a571-bf10-42bc-9ec4-26e02cd1c920 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:49.755145 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c074a571-bf10-42bc-9ec4-26e02cd1c920 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:49.758184 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f6395d02-b4de-4505-8d7f-848476c09077 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:49.759590 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f6395d02-b4de-4505-8d7f-848476c09077 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:49.760821 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f6395d02-b4de-4505-8d7f-848476c09077 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:49.761558 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f6395d02-b4de-4505-8d7f-848476c09077 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:49.762237 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c074a571-bf10-42bc-9ec4-26e02cd1c920 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1599 microversion: 2.20 time: 0.256574 Sep 14 01:05:49.762871 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 116/207] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:05:49 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1599 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:05:49.763280 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f6395d02-b4de-4505-8d7f-848476c09077 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:49.763939 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f6395d02-b4de-4505-8d7f-848476c09077 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:49.793052 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-eafd9c7b-382a-42c8-93f9-1c9e60d23eae tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:49.793739 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-eafd9c7b-382a-42c8-93f9-1c9e60d23eae tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:49.816334 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eafd9c7b-382a-42c8-93f9-1c9e60d23eae tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:49.816903 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eafd9c7b-382a-42c8-93f9-1c9e60d23eae tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:49.817339 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eafd9c7b-382a-42c8-93f9-1c9e60d23eae tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:49.818048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eafd9c7b-382a-42c8-93f9-1c9e60d23eae tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:49.818502 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eafd9c7b-382a-42c8-93f9-1c9e60d23eae tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:49.818927 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-eafd9c7b-382a-42c8-93f9-1c9e60d23eae tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:49.959515 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-eafd9c7b-382a-42c8-93f9-1c9e60d23eae tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.170629 Sep 14 01:05:49.960140 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 117/208] 10.222.0.42 () {60 vars in 1316 bytes} [Wed Sep 14 01:05:49 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 01:05:50.146590 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-f6395d02-b4de-4505-8d7f-848476c09077 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:50.155939 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-f6395d02-b4de-4505-8d7f-848476c09077 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.454114 Sep 14 01:05:50.161031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 92/209] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:49 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:50.392764 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-97802928-a87e-4c12-81d3-a1ea2ad0b19b req-e28a8ca2-37ad-45aa-aa4e-93f614a58706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f390b4d1-983e-4ea4-bb3f-e7e7e82a564a", "tag": "c55b96cb-5290-47cc-a378-c5a31536d115"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:50.420663 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-97802928-a87e-4c12-81d3-a1ea2ad0b19b req-e28a8ca2-37ad-45aa-aa4e-93f614a58706 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:50.421858 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-97802928-a87e-4c12-81d3-a1ea2ad0b19b req-e28a8ca2-37ad-45aa-aa4e-93f614a58706 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:50.423410 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-97802928-a87e-4c12-81d3-a1ea2ad0b19b req-e28a8ca2-37ad-45aa-aa4e-93f614a58706 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:50.450130 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-97802928-a87e-4c12-81d3-a1ea2ad0b19b req-e28a8ca2-37ad-45aa-aa4e-93f614a58706 service nova] Creating event network-changed:c55b96cb-5290-47cc-a378-c5a31536d115 for instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a on hv-cinder-85752 Sep 14 01:05:50.452290 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-eda2896e-1faf-4184-a1d1-edc507c8060f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:50.452902 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-eda2896e-1faf-4184-a1d1-edc507c8060f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:50.466454 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eda2896e-1faf-4184-a1d1-edc507c8060f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:50.467770 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eda2896e-1faf-4184-a1d1-edc507c8060f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:50.468389 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eda2896e-1faf-4184-a1d1-edc507c8060f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:50.469278 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eda2896e-1faf-4184-a1d1-edc507c8060f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:50.469884 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eda2896e-1faf-4184-a1d1-edc507c8060f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:50.470460 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eda2896e-1faf-4184-a1d1-edc507c8060f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:50.474853 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-97802928-a87e-4c12-81d3-a1ea2ad0b19b req-e28a8ca2-37ad-45aa-aa4e-93f614a58706 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075259 Sep 14 01:05:50.487060 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 118/210] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:05:50.758419 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-eda2896e-1faf-4184-a1d1-edc507c8060f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:50.770863 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-eda2896e-1faf-4184-a1d1-edc507c8060f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.320713 Sep 14 01:05:50.771963 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 93/211] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:50 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:51.188680 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-08778023-b2c0-4533-b112-879092abfe2f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:51.189494 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-08778023-b2c0-4533-b112-879092abfe2f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:51.196909 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-08778023-b2c0-4533-b112-879092abfe2f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:51.197662 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-08778023-b2c0-4533-b112-879092abfe2f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:51.198168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-08778023-b2c0-4533-b112-879092abfe2f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:51.198974 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-08778023-b2c0-4533-b112-879092abfe2f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:51.199494 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-08778023-b2c0-4533-b112-879092abfe2f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:51.200099 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-08778023-b2c0-4533-b112-879092abfe2f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:51.539903 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-08778023-b2c0-4533-b112-879092abfe2f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:51.549083 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-08778023-b2c0-4533-b112-879092abfe2f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1362 microversion: 2.1 time: 0.366785 Sep 14 01:05:51.575714 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 119/212] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:51 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1362 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:51.805492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-f270c18e-4895-4f9a-be61-d09925f6e651 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:51.806213 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-f270c18e-4895-4f9a-be61-d09925f6e651 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:51.815053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f270c18e-4895-4f9a-be61-d09925f6e651 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:51.815910 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f270c18e-4895-4f9a-be61-d09925f6e651 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:51.816737 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f270c18e-4895-4f9a-be61-d09925f6e651 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:51.818019 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f270c18e-4895-4f9a-be61-d09925f6e651 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:51.819085 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f270c18e-4895-4f9a-be61-d09925f6e651 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:51.819781 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f270c18e-4895-4f9a-be61-d09925f6e651 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:52.020963 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-cb010cf5-2738-4405-97af-8cb1fb3acaa5 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1464948344", "imageRef": "a2619027-0d8b-4ca3-9528-1ac3380cab5a", "flavorRef": "452", "networks": [{"uuid": "fb1d7035-fdb4-44fc-a6f7-c8481e97c847"}]}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:52.037455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-f270c18e-4895-4f9a-be61-d09925f6e651 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:52.047283 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-f270c18e-4895-4f9a-be61-d09925f6e651 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.246535 Sep 14 01:05:52.048515 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 94/213] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:51 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:52.082947 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-cb010cf5-2738-4405-97af-8cb1fb3acaa5 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] validate_networks() for [('fb1d7035-fdb4-44fc-a6f7-c8481e97c847', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:05:52.465016 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-08a6af1c-d5fd-440b-bbff-dbd39a6f1e29 req-b492c0b1-9de1-421d-8b9b-f07b3c14a149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02da4a4-64f7-47c0-a48f-9cdb71f30df9", "tag": "61ac6a9d-d543-4896-a237-b3287bcd2644"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:52.493199 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-08a6af1c-d5fd-440b-bbff-dbd39a6f1e29 req-b492c0b1-9de1-421d-8b9b-f07b3c14a149 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:52.494052 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-08a6af1c-d5fd-440b-bbff-dbd39a6f1e29 req-b492c0b1-9de1-421d-8b9b-f07b3c14a149 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:52.499225 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-08a6af1c-d5fd-440b-bbff-dbd39a6f1e29 req-b492c0b1-9de1-421d-8b9b-f07b3c14a149 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:52.523391 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-08a6af1c-d5fd-440b-bbff-dbd39a6f1e29 req-b492c0b1-9de1-421d-8b9b-f07b3c14a149 service nova] Creating event network-changed:61ac6a9d-d543-4896-a237-b3287bcd2644 for instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 on hv-cinder-85752 Sep 14 01:05:52.534439 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-08a6af1c-d5fd-440b-bbff-dbd39a6f1e29 req-b492c0b1-9de1-421d-8b9b-f07b3c14a149 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073290 Sep 14 01:05:52.536252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 95/214] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:05:52.590834 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ea2d5c09-6770-4958-8406-f30ccd986674 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:52.593611 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ea2d5c09-6770-4958-8406-f30ccd986674 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:52.604248 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ea2d5c09-6770-4958-8406-f30ccd986674 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:52.605045 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ea2d5c09-6770-4958-8406-f30ccd986674 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:52.606778 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ea2d5c09-6770-4958-8406-f30ccd986674 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:52.608077 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ea2d5c09-6770-4958-8406-f30ccd986674 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:52.611482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ea2d5c09-6770-4958-8406-f30ccd986674 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:52.612226 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ea2d5c09-6770-4958-8406-f30ccd986674 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:52.947265 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ea2d5c09-6770-4958-8406-f30ccd986674 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:52.961173 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ea2d5c09-6770-4958-8406-f30ccd986674 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1547 microversion: 2.1 time: 0.383850 Sep 14 01:05:52.963958 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 96/215] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:52 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1547 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:52.993060 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ba3683af-aa97-487a-906c-39a988d95baf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:52.993725 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ba3683af-aa97-487a-906c-39a988d95baf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:53.010755 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba3683af-aa97-487a-906c-39a988d95baf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:53.011282 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba3683af-aa97-487a-906c-39a988d95baf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:53.015055 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba3683af-aa97-487a-906c-39a988d95baf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:53.017079 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba3683af-aa97-487a-906c-39a988d95baf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:53.017571 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba3683af-aa97-487a-906c-39a988d95baf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:53.018010 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba3683af-aa97-487a-906c-39a988d95baf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:53.018777 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-cb010cf5-2738-4405-97af-8cb1fb3acaa5 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:05:53.019381 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-cb010cf5-2738-4405-97af-8cb1fb3acaa5 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:05:53.020727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-cb010cf5-2738-4405-97af-8cb1fb3acaa5 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:05:53.021325 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-cb010cf5-2738-4405-97af-8cb1fb3acaa5 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:05:53.021829 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-cb010cf5-2738-4405-97af-8cb1fb3acaa5 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:05:53.033378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cb010cf5-2738-4405-97af-8cb1fb3acaa5 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:53.033974 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cb010cf5-2738-4405-97af-8cb1fb3acaa5 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:53.034658 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cb010cf5-2738-4405-97af-8cb1fb3acaa5 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:53.035772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cb010cf5-2738-4405-97af-8cb1fb3acaa5 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:53.036434 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cb010cf5-2738-4405-97af-8cb1fb3acaa5 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:53.037233 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cb010cf5-2738-4405-97af-8cb1fb3acaa5 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:53.061256 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-cb010cf5-2738-4405-97af-8cb1fb3acaa5 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Getting quotas for project 6df5fe3a39fd4f9fb1ae104e43ec5529. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:05:53.067320 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-cb010cf5-2738-4405-97af-8cb1fb3acaa5 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Getting quotas for user 9bca70e61b80499eb07a668e11534257 and project 6df5fe3a39fd4f9fb1ae104e43ec5529. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:05:53.097488 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-cb010cf5-2738-4405-97af-8cb1fb3acaa5 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:05:53.100750 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-cb010cf5-2738-4405-97af-8cb1fb3acaa5 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a2619027-0d8b-4ca3-9528-1ac3380cab5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:05:53.137838 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ba3683af-aa97-487a-906c-39a988d95baf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155302 Sep 14 01:05:53.138431 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 97/216] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Sep 14 01:05:52 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:05:53.144071 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-f1beca13-879d-4ce4-9063-050c7d29caba tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:53.144928 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-f1beca13-879d-4ce4-9063-050c7d29caba tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:53.162146 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f1beca13-879d-4ce4-9063-050c7d29caba tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:53.162831 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f1beca13-879d-4ce4-9063-050c7d29caba tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:53.163473 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f1beca13-879d-4ce4-9063-050c7d29caba tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:53.164399 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f1beca13-879d-4ce4-9063-050c7d29caba tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:53.165001 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f1beca13-879d-4ce4-9063-050c7d29caba tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:53.165602 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f1beca13-879d-4ce4-9063-050c7d29caba tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:53.195110 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-cb010cf5-2738-4405-97af-8cb1fb3acaa5 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.176840 Sep 14 01:05:53.196089 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 120/217] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 01:05:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 01:05:53.239940 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b200df76-3e3e-4984-aacc-230465780ddc tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:53.241218 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b200df76-3e3e-4984-aacc-230465780ddc tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:53.344968 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b200df76-3e3e-4984-aacc-230465780ddc tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:53.354592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b200df76-3e3e-4984-aacc-230465780ddc tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1214 microversion: 2.1 time: 0.150931 Sep 14 01:05:53.372285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 121/218] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:53 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:53.479741 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-f1beca13-879d-4ce4-9063-050c7d29caba tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:53.489839 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-f1beca13-879d-4ce4-9063-050c7d29caba tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.349603 Sep 14 01:05:53.498816 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 98/219] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:53 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:54.387425 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d23d6351-da8d-4a34-a82c-2a1873587e60 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:54.388922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d23d6351-da8d-4a34-a82c-2a1873587e60 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:54.399535 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d23d6351-da8d-4a34-a82c-2a1873587e60 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:54.400465 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d23d6351-da8d-4a34-a82c-2a1873587e60 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:54.401402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d23d6351-da8d-4a34-a82c-2a1873587e60 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:54.402596 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d23d6351-da8d-4a34-a82c-2a1873587e60 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:54.403248 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d23d6351-da8d-4a34-a82c-2a1873587e60 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:54.403929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d23d6351-da8d-4a34-a82c-2a1873587e60 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:54.526542 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-b8bfa994-60b1-4642-b53c-3eeea5a5ae36 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:54.527991 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-b8bfa994-60b1-4642-b53c-3eeea5a5ae36 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:54.534958 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b8bfa994-60b1-4642-b53c-3eeea5a5ae36 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:54.536561 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b8bfa994-60b1-4642-b53c-3eeea5a5ae36 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:54.537194 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b8bfa994-60b1-4642-b53c-3eeea5a5ae36 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:54.538142 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b8bfa994-60b1-4642-b53c-3eeea5a5ae36 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:54.538812 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b8bfa994-60b1-4642-b53c-3eeea5a5ae36 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:54.540086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b8bfa994-60b1-4642-b53c-3eeea5a5ae36 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:54.830015 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d23d6351-da8d-4a34-a82c-2a1873587e60 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:54.840947 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b8bfa994-60b1-4642-b53c-3eeea5a5ae36 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:54.845420 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d23d6351-da8d-4a34-a82c-2a1873587e60 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1210 microversion: 2.1 time: 0.467176 Sep 14 01:05:54.846247 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 122/220] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:54 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1210 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:54.856759 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-b8bfa994-60b1-4642-b53c-3eeea5a5ae36 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.335760 Sep 14 01:05:54.857452 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 99/221] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:54 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:55.186519 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-841b9759-cf4a-48e4-bf89-1a9ec0d9b52a req-917b1e2b-b9ba-4ba0-adf5-c15f3460b9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e701782-aa36-44dd-be23-a59054d8cb32", "tag": "620985b6-d85e-4dfc-884a-1a64043ee00d"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:55.204384 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-841b9759-cf4a-48e4-bf89-1a9ec0d9b52a req-917b1e2b-b9ba-4ba0-adf5-c15f3460b9f0 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:55.212296 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-841b9759-cf4a-48e4-bf89-1a9ec0d9b52a req-917b1e2b-b9ba-4ba0-adf5-c15f3460b9f0 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:55.213109 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-841b9759-cf4a-48e4-bf89-1a9ec0d9b52a req-917b1e2b-b9ba-4ba0-adf5-c15f3460b9f0 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:55.228609 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-841b9759-cf4a-48e4-bf89-1a9ec0d9b52a req-917b1e2b-b9ba-4ba0-adf5-c15f3460b9f0 service nova] Creating event network-changed:620985b6-d85e-4dfc-884a-1a64043ee00d for instance 5e701782-aa36-44dd-be23-a59054d8cb32 on hv-cinder-85752 Sep 14 01:05:55.234873 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-841b9759-cf4a-48e4-bf89-1a9ec0d9b52a req-917b1e2b-b9ba-4ba0-adf5-c15f3460b9f0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052806 Sep 14 01:05:55.236109 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 123/222] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:05:55.872098 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-f0189c8f-5f21-4a87-a971-966b39a44f33 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:55.873335 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-f0189c8f-5f21-4a87-a971-966b39a44f33 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:55.881441 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4a762a3d-0970-4537-8d13-31312ef0108f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:55.882690 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4a762a3d-0970-4537-8d13-31312ef0108f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:55.893903 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f0189c8f-5f21-4a87-a971-966b39a44f33 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:55.897392 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4a762a3d-0970-4537-8d13-31312ef0108f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:55.898171 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f0189c8f-5f21-4a87-a971-966b39a44f33 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:55.898763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f0189c8f-5f21-4a87-a971-966b39a44f33 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:55.901383 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4a762a3d-0970-4537-8d13-31312ef0108f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:55.902171 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4a762a3d-0970-4537-8d13-31312ef0108f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:55.902401 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f0189c8f-5f21-4a87-a971-966b39a44f33 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:55.904392 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f0189c8f-5f21-4a87-a971-966b39a44f33 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:55.905007 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f0189c8f-5f21-4a87-a971-966b39a44f33 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:55.905497 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4a762a3d-0970-4537-8d13-31312ef0108f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:55.905885 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4a762a3d-0970-4537-8d13-31312ef0108f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:55.911054 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4a762a3d-0970-4537-8d13-31312ef0108f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:56.013686 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-f0189c8f-5f21-4a87-a971-966b39a44f33 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:56.024853 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-f0189c8f-5f21-4a87-a971-966b39a44f33 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1272 microversion: 2.1 time: 0.156302 Sep 14 01:05:56.042334 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 100/223] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:55 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:56.156498 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4a762a3d-0970-4537-8d13-31312ef0108f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:56.171683 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4a762a3d-0970-4537-8d13-31312ef0108f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.294763 Sep 14 01:05:56.172402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 124/224] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:55 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:57.052955 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-daf61029-391d-4471-b64b-5606cd4a2222 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:57.054187 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-daf61029-391d-4471-b64b-5606cd4a2222 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:57.061199 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-daf61029-391d-4471-b64b-5606cd4a2222 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:57.061688 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-daf61029-391d-4471-b64b-5606cd4a2222 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:57.062320 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-daf61029-391d-4471-b64b-5606cd4a2222 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:57.063036 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-daf61029-391d-4471-b64b-5606cd4a2222 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:57.063488 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-daf61029-391d-4471-b64b-5606cd4a2222 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:57.064095 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-daf61029-391d-4471-b64b-5606cd4a2222 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:57.205510 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d5f33f35-2444-4a61-a026-7e11b2db654d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:57.206117 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d5f33f35-2444-4a61-a026-7e11b2db654d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:57.212719 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d5f33f35-2444-4a61-a026-7e11b2db654d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:57.213208 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d5f33f35-2444-4a61-a026-7e11b2db654d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:57.213637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d5f33f35-2444-4a61-a026-7e11b2db654d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:57.214326 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d5f33f35-2444-4a61-a026-7e11b2db654d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:57.215023 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d5f33f35-2444-4a61-a026-7e11b2db654d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:57.215520 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d5f33f35-2444-4a61-a026-7e11b2db654d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:57.257270 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-daf61029-391d-4471-b64b-5606cd4a2222 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:57.266548 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-daf61029-391d-4471-b64b-5606cd4a2222 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1314 microversion: 2.1 time: 0.218174 Sep 14 01:05:57.267215 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 101/225] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:57 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:57.374417 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d5f33f35-2444-4a61-a026-7e11b2db654d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:57.384612 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d5f33f35-2444-4a61-a026-7e11b2db654d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.182859 Sep 14 01:05:57.385463 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 125/226] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:57 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:57.589697 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-5536588a-a64b-427e-837f-d4396a09f459 req-06b345ef-f328-4a63-811d-0232f20b8937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54efdf1e-6204-49c7-9f19-aaeecd377da5", "tag": "98762bb8-46f5-4fd3-b2c3-8918a3fa0923"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:05:57.600453 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-5536588a-a64b-427e-837f-d4396a09f459 req-06b345ef-f328-4a63-811d-0232f20b8937 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:57.601021 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-5536588a-a64b-427e-837f-d4396a09f459 req-06b345ef-f328-4a63-811d-0232f20b8937 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:57.601512 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-5536588a-a64b-427e-837f-d4396a09f459 req-06b345ef-f328-4a63-811d-0232f20b8937 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:57.614664 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-5536588a-a64b-427e-837f-d4396a09f459 req-06b345ef-f328-4a63-811d-0232f20b8937 service nova] Creating event network-changed:98762bb8-46f5-4fd3-b2c3-8918a3fa0923 for instance 54efdf1e-6204-49c7-9f19-aaeecd377da5 on hv-cinder-85752 Sep 14 01:05:57.620135 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-5536588a-a64b-427e-837f-d4396a09f459 req-06b345ef-f328-4a63-811d-0232f20b8937 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033940 Sep 14 01:05:57.620730 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 102/227] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:05:58.290629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3e025fc3-4f16-45db-bf8f-6091aed2f0e8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:58.291316 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3e025fc3-4f16-45db-bf8f-6091aed2f0e8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:58.297471 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e025fc3-4f16-45db-bf8f-6091aed2f0e8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:58.297984 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e025fc3-4f16-45db-bf8f-6091aed2f0e8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:58.298412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e025fc3-4f16-45db-bf8f-6091aed2f0e8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:58.299100 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e025fc3-4f16-45db-bf8f-6091aed2f0e8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:58.299543 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e025fc3-4f16-45db-bf8f-6091aed2f0e8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:58.299980 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3e025fc3-4f16-45db-bf8f-6091aed2f0e8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:58.409568 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2579e085-cc9b-4747-9572-bed58fb9e9cd tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:58.410281 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2579e085-cc9b-4747-9572-bed58fb9e9cd tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:58.417668 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2579e085-cc9b-4747-9572-bed58fb9e9cd tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:58.418591 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2579e085-cc9b-4747-9572-bed58fb9e9cd tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:58.418591 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2579e085-cc9b-4747-9572-bed58fb9e9cd tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:58.419160 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2579e085-cc9b-4747-9572-bed58fb9e9cd tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:58.419627 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2579e085-cc9b-4747-9572-bed58fb9e9cd tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:58.420050 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2579e085-cc9b-4747-9572-bed58fb9e9cd tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:58.436264 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3e025fc3-4f16-45db-bf8f-6091aed2f0e8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:58.445030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3e025fc3-4f16-45db-bf8f-6091aed2f0e8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1314 microversion: 2.1 time: 0.158625 Sep 14 01:05:58.445835 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 126/228] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:58 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:58.568271 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-2579e085-cc9b-4747-9572-bed58fb9e9cd tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:58.576244 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2579e085-cc9b-4747-9572-bed58fb9e9cd tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.170847 Sep 14 01:05:58.576831 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 103/229] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:58 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:05:59.468765 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a1d36dac-0060-479e-ab3a-974f38c82256 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:59.469307 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a1d36dac-0060-479e-ab3a-974f38c82256 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:59.475270 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a1d36dac-0060-479e-ab3a-974f38c82256 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:59.475812 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a1d36dac-0060-479e-ab3a-974f38c82256 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:59.476251 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a1d36dac-0060-479e-ab3a-974f38c82256 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:59.476942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a1d36dac-0060-479e-ab3a-974f38c82256 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:59.477401 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a1d36dac-0060-479e-ab3a-974f38c82256 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:59.477824 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a1d36dac-0060-479e-ab3a-974f38c82256 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:59.600145 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-3360d007-6ebd-451f-9278-16e8150de627 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:05:59.600756 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-3360d007-6ebd-451f-9278-16e8150de627 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:05:59.606002 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a1d36dac-0060-479e-ab3a-974f38c82256 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:59.607326 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3360d007-6ebd-451f-9278-16e8150de627 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:59.607855 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3360d007-6ebd-451f-9278-16e8150de627 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:59.608301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3360d007-6ebd-451f-9278-16e8150de627 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:59.609000 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3360d007-6ebd-451f-9278-16e8150de627 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:05:59.609458 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3360d007-6ebd-451f-9278-16e8150de627 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:05:59.609880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3360d007-6ebd-451f-9278-16e8150de627 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:05:59.613611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a1d36dac-0060-479e-ab3a-974f38c82256 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1314 microversion: 2.1 time: 0.148782 Sep 14 01:05:59.614353 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 127/230] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:59 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:05:59.736240 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-3360d007-6ebd-451f-9278-16e8150de627 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:05:59.744179 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-3360d007-6ebd-451f-9278-16e8150de627 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.148427 Sep 14 01:05:59.744746 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 104/231] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:05:59 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:00.636402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ba7f4062-9dc2-4287-9139-466bfc867a47 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:00.637089 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ba7f4062-9dc2-4287-9139-466bfc867a47 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:00.643236 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ba7f4062-9dc2-4287-9139-466bfc867a47 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:00.643747 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ba7f4062-9dc2-4287-9139-466bfc867a47 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:00.644176 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ba7f4062-9dc2-4287-9139-466bfc867a47 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:00.645209 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ba7f4062-9dc2-4287-9139-466bfc867a47 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:00.645716 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ba7f4062-9dc2-4287-9139-466bfc867a47 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:00.646135 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ba7f4062-9dc2-4287-9139-466bfc867a47 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:00.767838 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-42233be0-fd6f-4f6b-bcee-565d97d5a686 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:00.768472 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-42233be0-fd6f-4f6b-bcee-565d97d5a686 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:00.774607 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-42233be0-fd6f-4f6b-bcee-565d97d5a686 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:00.775096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-42233be0-fd6f-4f6b-bcee-565d97d5a686 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:00.775529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-42233be0-fd6f-4f6b-bcee-565d97d5a686 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:00.776254 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-42233be0-fd6f-4f6b-bcee-565d97d5a686 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:00.776709 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-42233be0-fd6f-4f6b-bcee-565d97d5a686 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:00.777130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-42233be0-fd6f-4f6b-bcee-565d97d5a686 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:00.779765 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ba7f4062-9dc2-4287-9139-466bfc867a47 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:00.788185 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ba7f4062-9dc2-4287-9139-466bfc867a47 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1314 microversion: 2.1 time: 0.155665 Sep 14 01:06:00.788766 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 128/232] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:00 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:00.918567 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-42233be0-fd6f-4f6b-bcee-565d97d5a686 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:00.926818 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-42233be0-fd6f-4f6b-bcee-565d97d5a686 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.163700 Sep 14 01:06:00.927388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 105/233] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:00 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:01.811470 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-27a09ef9-1a6a-4cd5-9282-7e8ae3ac35cf tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:01.812009 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-27a09ef9-1a6a-4cd5-9282-7e8ae3ac35cf tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:01.818145 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-27a09ef9-1a6a-4cd5-9282-7e8ae3ac35cf tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:01.818617 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-27a09ef9-1a6a-4cd5-9282-7e8ae3ac35cf tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:01.819044 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-27a09ef9-1a6a-4cd5-9282-7e8ae3ac35cf tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:01.819753 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-27a09ef9-1a6a-4cd5-9282-7e8ae3ac35cf tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:01.820221 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-27a09ef9-1a6a-4cd5-9282-7e8ae3ac35cf tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:01.820637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-27a09ef9-1a6a-4cd5-9282-7e8ae3ac35cf tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:01.824622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:01.950227 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-1d9035f7-5521-426b-87db-3719786166ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:01.950836 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-1d9035f7-5521-426b-87db-3719786166ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:01.951829 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-27a09ef9-1a6a-4cd5-9282-7e8ae3ac35cf tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:01.957955 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1d9035f7-5521-426b-87db-3719786166ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:01.958437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1d9035f7-5521-426b-87db-3719786166ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:01.959048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1d9035f7-5521-426b-87db-3719786166ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:01.959807 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1d9035f7-5521-426b-87db-3719786166ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:01.960247 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-27a09ef9-1a6a-4cd5-9282-7e8ae3ac35cf tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1314 microversion: 2.1 time: 0.152670 Sep 14 01:06:01.960366 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1d9035f7-5521-426b-87db-3719786166ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:01.960665 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1d9035f7-5521-426b-87db-3719786166ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:01.961161 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 129/234] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:01 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:02.088846 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-1d9035f7-5521-426b-87db-3719786166ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:02.097093 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-1d9035f7-5521-426b-87db-3719786166ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.150700 Sep 14 01:06:02.097841 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 106/235] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:01 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:02.983466 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fd8fb90a-0e71-4499-a816-61f90ab5b3e2 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:02.984116 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fd8fb90a-0e71-4499-a816-61f90ab5b3e2 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:02.990774 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fd8fb90a-0e71-4499-a816-61f90ab5b3e2 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:02.991254 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fd8fb90a-0e71-4499-a816-61f90ab5b3e2 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:02.991731 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fd8fb90a-0e71-4499-a816-61f90ab5b3e2 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:02.992419 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fd8fb90a-0e71-4499-a816-61f90ab5b3e2 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:02.992871 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fd8fb90a-0e71-4499-a816-61f90ab5b3e2 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:02.993294 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fd8fb90a-0e71-4499-a816-61f90ab5b3e2 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:03.048149 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:03.119790 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-416e71df-ebf2-4808-95b3-aaa352d46e83 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:03.120393 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-416e71df-ebf2-4808-95b3-aaa352d46e83 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:03.124606 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fd8fb90a-0e71-4499-a816-61f90ab5b3e2 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:03.126804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-416e71df-ebf2-4808-95b3-aaa352d46e83 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:03.127281 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-416e71df-ebf2-4808-95b3-aaa352d46e83 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:03.127745 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-416e71df-ebf2-4808-95b3-aaa352d46e83 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:03.128430 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-416e71df-ebf2-4808-95b3-aaa352d46e83 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:03.129528 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-416e71df-ebf2-4808-95b3-aaa352d46e83 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:03.130184 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-416e71df-ebf2-4808-95b3-aaa352d46e83 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:03.132821 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fd8fb90a-0e71-4499-a816-61f90ab5b3e2 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1314 microversion: 2.1 time: 0.153182 Sep 14 01:06:03.133411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 130/236] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:02 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:03.257383 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-416e71df-ebf2-4808-95b3-aaa352d46e83 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:03.265430 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-416e71df-ebf2-4808-95b3-aaa352d46e83 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.149441 Sep 14 01:06:03.266225 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 107/237] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:03 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:04.159422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7d6ed182-7fd7-4754-a1e1-089085007c47 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:04.160584 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7d6ed182-7fd7-4754-a1e1-089085007c47 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:04.162383 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=8 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:04.167737 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7d6ed182-7fd7-4754-a1e1-089085007c47 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:04.168217 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7d6ed182-7fd7-4754-a1e1-089085007c47 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:04.168645 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7d6ed182-7fd7-4754-a1e1-089085007c47 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:04.169325 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7d6ed182-7fd7-4754-a1e1-089085007c47 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:04.169774 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7d6ed182-7fd7-4754-a1e1-089085007c47 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:04.170193 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7d6ed182-7fd7-4754-a1e1-089085007c47 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:04.289545 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6a9973c8-697a-4a94-95fe-5af90ea3b05d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:04.290148 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-6a9973c8-697a-4a94-95fe-5af90ea3b05d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:04.292605 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=83 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:04.297826 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6a9973c8-697a-4a94-95fe-5af90ea3b05d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:04.298306 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6a9973c8-697a-4a94-95fe-5af90ea3b05d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:04.298703 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7d6ed182-7fd7-4754-a1e1-089085007c47 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:04.298906 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6a9973c8-697a-4a94-95fe-5af90ea3b05d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:04.299609 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6a9973c8-697a-4a94-95fe-5af90ea3b05d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:04.300091 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6a9973c8-697a-4a94-95fe-5af90ea3b05d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:04.300528 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6a9973c8-697a-4a94-95fe-5af90ea3b05d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:04.306332 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7d6ed182-7fd7-4754-a1e1-089085007c47 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1314 microversion: 2.1 time: 0.150740 Sep 14 01:06:04.307107 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 131/238] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:04 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:04.435221 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6a9973c8-697a-4a94-95fe-5af90ea3b05d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:04.442911 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-6a9973c8-697a-4a94-95fe-5af90ea3b05d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.157937 Sep 14 01:06:04.443466 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 108/239] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:04 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:05.328589 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ffa3ed2a-25e5-4435-b1d4-5351ffa4b51b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:05.329219 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ffa3ed2a-25e5-4435-b1d4-5351ffa4b51b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:05.335730 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ffa3ed2a-25e5-4435-b1d4-5351ffa4b51b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:05.336202 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ffa3ed2a-25e5-4435-b1d4-5351ffa4b51b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:05.336647 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ffa3ed2a-25e5-4435-b1d4-5351ffa4b51b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:05.337319 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ffa3ed2a-25e5-4435-b1d4-5351ffa4b51b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:05.337768 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ffa3ed2a-25e5-4435-b1d4-5351ffa4b51b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:05.338183 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ffa3ed2a-25e5-4435-b1d4-5351ffa4b51b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:05.468213 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2ea079be-3578-40e0-87cf-461b35b0b3f6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:05.469686 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2ea079be-3578-40e0-87cf-461b35b0b3f6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:05.473904 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ffa3ed2a-25e5-4435-b1d4-5351ffa4b51b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:05.478897 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2ea079be-3578-40e0-87cf-461b35b0b3f6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:05.479965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2ea079be-3578-40e0-87cf-461b35b0b3f6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:05.480915 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2ea079be-3578-40e0-87cf-461b35b0b3f6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:05.483243 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ffa3ed2a-25e5-4435-b1d4-5351ffa4b51b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1314 microversion: 2.1 time: 0.157558 Sep 14 01:06:05.483243 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 132/240] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:05 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:05.484519 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2ea079be-3578-40e0-87cf-461b35b0b3f6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:05.484996 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2ea079be-3578-40e0-87cf-461b35b0b3f6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:05.485426 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2ea079be-3578-40e0-87cf-461b35b0b3f6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:05.490312 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:05.629333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-2ea079be-3578-40e0-87cf-461b35b0b3f6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:05.638991 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2ea079be-3578-40e0-87cf-461b35b0b3f6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.176591 Sep 14 01:06:05.640183 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 109/241] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:05 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:06.506412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-35cd7b08-3091-4aa2-820b-3b8d90d33c7f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:06.507011 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-35cd7b08-3091-4aa2-820b-3b8d90d33c7f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:06.512920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-35cd7b08-3091-4aa2-820b-3b8d90d33c7f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:06.513399 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-35cd7b08-3091-4aa2-820b-3b8d90d33c7f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:06.513831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-35cd7b08-3091-4aa2-820b-3b8d90d33c7f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:06.514769 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-35cd7b08-3091-4aa2-820b-3b8d90d33c7f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:06.515218 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-35cd7b08-3091-4aa2-820b-3b8d90d33c7f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:06.515667 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-35cd7b08-3091-4aa2-820b-3b8d90d33c7f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:06.648794 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-35cd7b08-3091-4aa2-820b-3b8d90d33c7f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:06.657372 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-35cd7b08-3091-4aa2-820b-3b8d90d33c7f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1314 microversion: 2.1 time: 0.155675 Sep 14 01:06:06.658004 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 133/242] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:06 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:06.663817 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-701691da-a2df-4444-98f7-e9dec2c348e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:06.664422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-701691da-a2df-4444-98f7-e9dec2c348e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:06.671334 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-701691da-a2df-4444-98f7-e9dec2c348e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:06.671845 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-701691da-a2df-4444-98f7-e9dec2c348e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:06.672397 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-701691da-a2df-4444-98f7-e9dec2c348e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:06.673201 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-701691da-a2df-4444-98f7-e9dec2c348e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:06.673649 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-701691da-a2df-4444-98f7-e9dec2c348e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:06.674064 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-701691da-a2df-4444-98f7-e9dec2c348e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:06.806330 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-701691da-a2df-4444-98f7-e9dec2c348e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:06.813825 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-701691da-a2df-4444-98f7-e9dec2c348e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.155067 Sep 14 01:06:06.814383 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 110/243] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:06 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:07.681525 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-643a5cd2-c216-4569-8e2f-0fa7bc79ede9 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:07.682132 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-643a5cd2-c216-4569-8e2f-0fa7bc79ede9 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:07.688086 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-643a5cd2-c216-4569-8e2f-0fa7bc79ede9 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:07.688568 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-643a5cd2-c216-4569-8e2f-0fa7bc79ede9 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:07.689000 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-643a5cd2-c216-4569-8e2f-0fa7bc79ede9 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:07.689711 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-643a5cd2-c216-4569-8e2f-0fa7bc79ede9 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:07.690160 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-643a5cd2-c216-4569-8e2f-0fa7bc79ede9 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:07.690578 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-643a5cd2-c216-4569-8e2f-0fa7bc79ede9 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:07.817725 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-643a5cd2-c216-4569-8e2f-0fa7bc79ede9 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:07.825260 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-643a5cd2-c216-4569-8e2f-0fa7bc79ede9 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1314 microversion: 2.1 time: 0.147562 Sep 14 01:06:07.825829 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 134/244] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:07 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:07.836566 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-3886cf29-667e-46c2-aabd-a77192072f18 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:07.837169 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-3886cf29-667e-46c2-aabd-a77192072f18 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:07.843641 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3886cf29-667e-46c2-aabd-a77192072f18 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:07.844120 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3886cf29-667e-46c2-aabd-a77192072f18 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:07.844547 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3886cf29-667e-46c2-aabd-a77192072f18 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:07.845224 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3886cf29-667e-46c2-aabd-a77192072f18 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:07.845674 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3886cf29-667e-46c2-aabd-a77192072f18 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:07.846093 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3886cf29-667e-46c2-aabd-a77192072f18 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:07.976801 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-3886cf29-667e-46c2-aabd-a77192072f18 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:07.984388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-3886cf29-667e-46c2-aabd-a77192072f18 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.151623 Sep 14 01:06:07.984942 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 111/245] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:07 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:08.847952 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-44110fad-4d66-483f-b71e-fef23debbf32 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:08.848628 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-44110fad-4d66-483f-b71e-fef23debbf32 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:08.854877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-44110fad-4d66-483f-b71e-fef23debbf32 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:08.855359 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-44110fad-4d66-483f-b71e-fef23debbf32 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:08.855816 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-44110fad-4d66-483f-b71e-fef23debbf32 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:08.856595 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-44110fad-4d66-483f-b71e-fef23debbf32 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:08.857235 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-44110fad-4d66-483f-b71e-fef23debbf32 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:08.857950 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-44110fad-4d66-483f-b71e-fef23debbf32 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:09.010171 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-5da4fa5a-0691-4ce8-afd4-c4d9b7f8b162 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:09.011704 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-5da4fa5a-0691-4ce8-afd4-c4d9b7f8b162 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:09.012780 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-44110fad-4d66-483f-b71e-fef23debbf32 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:09.023910 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5da4fa5a-0691-4ce8-afd4-c4d9b7f8b162 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:09.023910 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5da4fa5a-0691-4ce8-afd4-c4d9b7f8b162 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:09.023910 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5da4fa5a-0691-4ce8-afd4-c4d9b7f8b162 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:09.024195 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5da4fa5a-0691-4ce8-afd4-c4d9b7f8b162 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:09.024512 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5da4fa5a-0691-4ce8-afd4-c4d9b7f8b162 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:09.024936 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5da4fa5a-0691-4ce8-afd4-c4d9b7f8b162 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:09.038053 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-44110fad-4d66-483f-b71e-fef23debbf32 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1314 microversion: 2.1 time: 0.194609 Sep 14 01:06:09.038550 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 135/246] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:08 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:09.395906 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-5da4fa5a-0691-4ce8-afd4-c4d9b7f8b162 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:09.403698 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-5da4fa5a-0691-4ce8-afd4-c4d9b7f8b162 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.400130 Sep 14 01:06:09.404290 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 112/247] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:09 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:10.014697 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-f5144818-ab6c-44b2-9e37-52196d7c7980 req-ace96f1c-1b69-4757-a4fe-7b03a49dcc2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54efdf1e-6204-49c7-9f19-aaeecd377da5", "name": "network-vif-plugged", "status": "completed", "tag": "98762bb8-46f5-4fd3-b2c3-8918a3fa0923"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:06:10.024994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-f5144818-ab6c-44b2-9e37-52196d7c7980 req-ace96f1c-1b69-4757-a4fe-7b03a49dcc2d service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:10.025488 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-f5144818-ab6c-44b2-9e37-52196d7c7980 req-ace96f1c-1b69-4757-a4fe-7b03a49dcc2d service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:10.025940 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-f5144818-ab6c-44b2-9e37-52196d7c7980 req-ace96f1c-1b69-4757-a4fe-7b03a49dcc2d service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:10.039296 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-f5144818-ab6c-44b2-9e37-52196d7c7980 req-ace96f1c-1b69-4757-a4fe-7b03a49dcc2d service nova] Creating event network-vif-plugged:98762bb8-46f5-4fd3-b2c3-8918a3fa0923 for instance 54efdf1e-6204-49c7-9f19-aaeecd377da5 on hv-cinder-85752 Sep 14 01:06:10.044865 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-f5144818-ab6c-44b2-9e37-52196d7c7980 req-ace96f1c-1b69-4757-a4fe-7b03a49dcc2d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034098 Sep 14 01:06:10.045767 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 136/248] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:06:10.063299 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-15fdb985-c9fb-4767-9497-28da3a24267a tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:10.064486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-15fdb985-c9fb-4767-9497-28da3a24267a tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:10.071682 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-15fdb985-c9fb-4767-9497-28da3a24267a tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:10.072165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-15fdb985-c9fb-4767-9497-28da3a24267a tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:10.072595 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-15fdb985-c9fb-4767-9497-28da3a24267a tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:10.073282 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-15fdb985-c9fb-4767-9497-28da3a24267a tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:10.073728 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-15fdb985-c9fb-4767-9497-28da3a24267a tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:10.074152 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-15fdb985-c9fb-4767-9497-28da3a24267a tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:10.237107 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-15fdb985-c9fb-4767-9497-28da3a24267a tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:10.245676 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-15fdb985-c9fb-4767-9497-28da3a24267a tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1314 microversion: 2.1 time: 0.186057 Sep 14 01:06:10.246749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 113/249] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:10 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:10.427307 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d5650ce1-0bd7-4d1c-be0a-eb5491552865 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:10.428145 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d5650ce1-0bd7-4d1c-be0a-eb5491552865 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:10.431131 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:10.435852 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d5650ce1-0bd7-4d1c-be0a-eb5491552865 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:10.436703 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d5650ce1-0bd7-4d1c-be0a-eb5491552865 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:10.437477 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d5650ce1-0bd7-4d1c-be0a-eb5491552865 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:10.438922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d5650ce1-0bd7-4d1c-be0a-eb5491552865 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:10.440010 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d5650ce1-0bd7-4d1c-be0a-eb5491552865 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:10.440819 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d5650ce1-0bd7-4d1c-be0a-eb5491552865 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:10.578290 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d5650ce1-0bd7-4d1c-be0a-eb5491552865 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:10.586506 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d5650ce1-0bd7-4d1c-be0a-eb5491552865 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.163828 Sep 14 01:06:10.587067 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 137/250] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:10 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:11.060401 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-510ad1ea-8c14-4141-bd0d-fd4565cadc35 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:11.060917 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-510ad1ea-8c14-4141-bd0d-fd4565cadc35 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:11.067780 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-510ad1ea-8c14-4141-bd0d-fd4565cadc35 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:11.068331 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-510ad1ea-8c14-4141-bd0d-fd4565cadc35 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:11.068711 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-510ad1ea-8c14-4141-bd0d-fd4565cadc35 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:11.069394 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-510ad1ea-8c14-4141-bd0d-fd4565cadc35 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:11.069837 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-510ad1ea-8c14-4141-bd0d-fd4565cadc35 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:11.070259 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-510ad1ea-8c14-4141-bd0d-fd4565cadc35 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:11.096396 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-510ad1ea-8c14-4141-bd0d-fd4565cadc35 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Going to try to terminate instance {{(pid=120620) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:06:11.194921 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-510ad1ea-8c14-4141-bd0d-fd4565cadc35 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "DELETE /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 204 len: 0 microversion: 2.1 time: 0.138263 Sep 14 01:06:11.195529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 114/251] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:06:11 2022] DELETE /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 01:06:11.203936 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8dbafca4-1fb7-4915-8b5b-d99c8f05f899 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:11.204625 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8dbafca4-1fb7-4915-8b5b-d99c8f05f899 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:11.210786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8dbafca4-1fb7-4915-8b5b-d99c8f05f899 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:11.211357 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8dbafca4-1fb7-4915-8b5b-d99c8f05f899 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:11.211826 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8dbafca4-1fb7-4915-8b5b-d99c8f05f899 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:11.212544 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8dbafca4-1fb7-4915-8b5b-d99c8f05f899 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:11.212997 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8dbafca4-1fb7-4915-8b5b-d99c8f05f899 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:11.213423 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8dbafca4-1fb7-4915-8b5b-d99c8f05f899 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:11.270126 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6bd012b3-a664-45e9-ae3e-4240e20ed575 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:11.270819 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-6bd012b3-a664-45e9-ae3e-4240e20ed575 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:11.277207 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6bd012b3-a664-45e9-ae3e-4240e20ed575 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:11.277702 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6bd012b3-a664-45e9-ae3e-4240e20ed575 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:11.278138 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6bd012b3-a664-45e9-ae3e-4240e20ed575 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:11.278831 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6bd012b3-a664-45e9-ae3e-4240e20ed575 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:11.279285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6bd012b3-a664-45e9-ae3e-4240e20ed575 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:11.279742 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6bd012b3-a664-45e9-ae3e-4240e20ed575 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:11.343992 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8dbafca4-1fb7-4915-8b5b-d99c8f05f899 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:11.352657 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8dbafca4-1fb7-4915-8b5b-d99c8f05f899 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1553 microversion: 2.1 time: 0.152552 Sep 14 01:06:11.353226 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 138/252] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:11 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:11.413217 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6bd012b3-a664-45e9-ae3e-4240e20ed575 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:11.420943 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-6bd012b3-a664-45e9-ae3e-4240e20ed575 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1314 microversion: 2.1 time: 0.155271 Sep 14 01:06:11.421521 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 115/253] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:11 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:11.610314 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1d691a9a-805f-42db-8ac8-b2178d0de75f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:11.610917 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1d691a9a-805f-42db-8ac8-b2178d0de75f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:11.616844 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1d691a9a-805f-42db-8ac8-b2178d0de75f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:11.617315 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1d691a9a-805f-42db-8ac8-b2178d0de75f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:11.617743 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1d691a9a-805f-42db-8ac8-b2178d0de75f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:11.618414 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1d691a9a-805f-42db-8ac8-b2178d0de75f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:11.618858 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1d691a9a-805f-42db-8ac8-b2178d0de75f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:11.619267 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1d691a9a-805f-42db-8ac8-b2178d0de75f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:11.746870 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1d691a9a-805f-42db-8ac8-b2178d0de75f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:11.755064 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1d691a9a-805f-42db-8ac8-b2178d0de75f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.148594 Sep 14 01:06:11.755639 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 139/254] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:11 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:12.374985 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8adceac4-95c1-42ff-9fb6-c35a07a203fe tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:12.375615 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8adceac4-95c1-42ff-9fb6-c35a07a203fe tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:12.382169 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8adceac4-95c1-42ff-9fb6-c35a07a203fe tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:12.382652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8adceac4-95c1-42ff-9fb6-c35a07a203fe tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:12.383086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8adceac4-95c1-42ff-9fb6-c35a07a203fe tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:12.383801 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8adceac4-95c1-42ff-9fb6-c35a07a203fe tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:12.384258 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8adceac4-95c1-42ff-9fb6-c35a07a203fe tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:12.384681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8adceac4-95c1-42ff-9fb6-c35a07a203fe tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:12.443745 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-05aa68fb-31af-4a75-b0e6-bd667c3f2b98 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:12.444437 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-05aa68fb-31af-4a75-b0e6-bd667c3f2b98 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:12.450348 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-05aa68fb-31af-4a75-b0e6-bd667c3f2b98 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:12.450896 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-05aa68fb-31af-4a75-b0e6-bd667c3f2b98 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:12.451390 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-05aa68fb-31af-4a75-b0e6-bd667c3f2b98 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:12.452103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-05aa68fb-31af-4a75-b0e6-bd667c3f2b98 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:12.452546 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-05aa68fb-31af-4a75-b0e6-bd667c3f2b98 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:12.452958 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-05aa68fb-31af-4a75-b0e6-bd667c3f2b98 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:12.515590 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8adceac4-95c1-42ff-9fb6-c35a07a203fe tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:12.524972 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8adceac4-95c1-42ff-9fb6-c35a07a203fe tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1553 microversion: 2.1 time: 0.153736 Sep 14 01:06:12.525560 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 116/255] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:12 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:12.593555 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-05aa68fb-31af-4a75-b0e6-bd667c3f2b98 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:12.602267 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-05aa68fb-31af-4a75-b0e6-bd667c3f2b98 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1314 microversion: 2.1 time: 0.162609 Sep 14 01:06:12.602827 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 140/256] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:12 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:12.778097 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7805b7c5-1a2d-48cb-84c6-199c043daf7d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:12.778622 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7805b7c5-1a2d-48cb-84c6-199c043daf7d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:12.784573 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7805b7c5-1a2d-48cb-84c6-199c043daf7d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:12.785313 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7805b7c5-1a2d-48cb-84c6-199c043daf7d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:12.785748 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7805b7c5-1a2d-48cb-84c6-199c043daf7d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:12.786425 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7805b7c5-1a2d-48cb-84c6-199c043daf7d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:12.786876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7805b7c5-1a2d-48cb-84c6-199c043daf7d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:12.787294 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7805b7c5-1a2d-48cb-84c6-199c043daf7d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:12.916502 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7805b7c5-1a2d-48cb-84c6-199c043daf7d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:12.924073 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7805b7c5-1a2d-48cb-84c6-199c043daf7d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.149868 Sep 14 01:06:12.924635 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 117/257] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:12 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:13.547969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e510b89e-0efd-4a38-9c9a-df9c6ff02ab9 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:13.548585 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e510b89e-0efd-4a38-9c9a-df9c6ff02ab9 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:13.554681 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e510b89e-0efd-4a38-9c9a-df9c6ff02ab9 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:13.555165 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e510b89e-0efd-4a38-9c9a-df9c6ff02ab9 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:13.555621 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e510b89e-0efd-4a38-9c9a-df9c6ff02ab9 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:13.556307 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e510b89e-0efd-4a38-9c9a-df9c6ff02ab9 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:13.556759 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e510b89e-0efd-4a38-9c9a-df9c6ff02ab9 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:13.557179 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e510b89e-0efd-4a38-9c9a-df9c6ff02ab9 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:13.625599 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-38bc15bb-2754-4adb-a1d2-2a58c1365ff8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:13.626202 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-38bc15bb-2754-4adb-a1d2-2a58c1365ff8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:13.633261 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-38bc15bb-2754-4adb-a1d2-2a58c1365ff8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:13.633719 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-38bc15bb-2754-4adb-a1d2-2a58c1365ff8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:13.634146 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-38bc15bb-2754-4adb-a1d2-2a58c1365ff8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:13.634828 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-38bc15bb-2754-4adb-a1d2-2a58c1365ff8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:13.635274 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-38bc15bb-2754-4adb-a1d2-2a58c1365ff8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:13.635722 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-38bc15bb-2754-4adb-a1d2-2a58c1365ff8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:13.688503 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e510b89e-0efd-4a38-9c9a-df9c6ff02ab9 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:13.697407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e510b89e-0efd-4a38-9c9a-df9c6ff02ab9 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1553 microversion: 2.1 time: 0.153280 Sep 14 01:06:13.697982 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 141/258] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:13 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:13.762790 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-38bc15bb-2754-4adb-a1d2-2a58c1365ff8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:13.771270 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-38bc15bb-2754-4adb-a1d2-2a58c1365ff8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1314 microversion: 2.1 time: 0.149578 Sep 14 01:06:13.771859 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 118/259] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:13 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:13.948034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f81d8fea-c999-4ede-a873-c76eedce28e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:13.948633 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f81d8fea-c999-4ede-a873-c76eedce28e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:13.954543 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f81d8fea-c999-4ede-a873-c76eedce28e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:13.955015 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f81d8fea-c999-4ede-a873-c76eedce28e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:13.955441 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f81d8fea-c999-4ede-a873-c76eedce28e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:13.956146 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f81d8fea-c999-4ede-a873-c76eedce28e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:13.957354 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f81d8fea-c999-4ede-a873-c76eedce28e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:13.957943 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f81d8fea-c999-4ede-a873-c76eedce28e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:14.085156 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f81d8fea-c999-4ede-a873-c76eedce28e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:14.092645 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f81d8fea-c999-4ede-a873-c76eedce28e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.148438 Sep 14 01:06:14.093211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 142/260] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:13 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:14.720783 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-b729e9ea-5077-4f2d-8331-99a467650222 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:14.721389 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-b729e9ea-5077-4f2d-8331-99a467650222 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:14.728697 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b729e9ea-5077-4f2d-8331-99a467650222 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:14.729177 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b729e9ea-5077-4f2d-8331-99a467650222 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:14.729607 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b729e9ea-5077-4f2d-8331-99a467650222 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:14.730289 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b729e9ea-5077-4f2d-8331-99a467650222 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:14.730740 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b729e9ea-5077-4f2d-8331-99a467650222 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:14.731157 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b729e9ea-5077-4f2d-8331-99a467650222 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:14.793906 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c006e27e-98dd-40c7-85e2-44bc83f14313 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:14.794521 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c006e27e-98dd-40c7-85e2-44bc83f14313 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:14.801519 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c006e27e-98dd-40c7-85e2-44bc83f14313 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:14.802234 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c006e27e-98dd-40c7-85e2-44bc83f14313 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:14.802673 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c006e27e-98dd-40c7-85e2-44bc83f14313 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:14.803366 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c006e27e-98dd-40c7-85e2-44bc83f14313 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:14.803982 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c006e27e-98dd-40c7-85e2-44bc83f14313 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:14.804405 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c006e27e-98dd-40c7-85e2-44bc83f14313 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:14.869703 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b729e9ea-5077-4f2d-8331-99a467650222 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:14.879110 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-b729e9ea-5077-4f2d-8331-99a467650222 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1553 microversion: 2.1 time: 0.161442 Sep 14 01:06:14.879721 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 119/261] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:14 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:14.943123 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c006e27e-98dd-40c7-85e2-44bc83f14313 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:14.951013 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c006e27e-98dd-40c7-85e2-44bc83f14313 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1498 microversion: 2.1 time: 0.161262 Sep 14 01:06:14.951672 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 143/262] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:14 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:15.115761 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ac8c190c-a62a-45f2-8854-a1ef4bbbf6ae tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:15.116364 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ac8c190c-a62a-45f2-8854-a1ef4bbbf6ae tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:15.122160 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac8c190c-a62a-45f2-8854-a1ef4bbbf6ae tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:15.122701 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac8c190c-a62a-45f2-8854-a1ef4bbbf6ae tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:15.123176 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac8c190c-a62a-45f2-8854-a1ef4bbbf6ae tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:15.123954 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac8c190c-a62a-45f2-8854-a1ef4bbbf6ae tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:15.124485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac8c190c-a62a-45f2-8854-a1ef4bbbf6ae tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:15.124855 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac8c190c-a62a-45f2-8854-a1ef4bbbf6ae tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:15.263290 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ac8c190c-a62a-45f2-8854-a1ef4bbbf6ae tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:15.272102 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ac8c190c-a62a-45f2-8854-a1ef4bbbf6ae tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.160578 Sep 14 01:06:15.273000 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 120/263] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:15 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:15.570635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-02b414ba-c7eb-40ee-bb46-abc3e024575b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:15.571259 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-02b414ba-c7eb-40ee-bb46-abc3e024575b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:15.577276 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-02b414ba-c7eb-40ee-bb46-abc3e024575b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:15.577756 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-02b414ba-c7eb-40ee-bb46-abc3e024575b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:15.578186 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-02b414ba-c7eb-40ee-bb46-abc3e024575b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:15.578867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-02b414ba-c7eb-40ee-bb46-abc3e024575b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:15.579316 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-02b414ba-c7eb-40ee-bb46-abc3e024575b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:15.579765 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-02b414ba-c7eb-40ee-bb46-abc3e024575b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:15.604447 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-02b414ba-c7eb-40ee-bb46-abc3e024575b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Going to try to terminate instance {{(pid=120621) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:06:15.666307 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:15.698150 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-02b414ba-c7eb-40ee-bb46-abc3e024575b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "DELETE /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 204 len: 0 microversion: 2.1 time: 0.131843 Sep 14 01:06:15.698734 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 144/264] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:06:15 2022] DELETE /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 01:06:15.707514 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d344d1ce-5906-4b31-8b9c-3244be72e03e tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:15.708145 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d344d1ce-5906-4b31-8b9c-3244be72e03e tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:15.714277 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d344d1ce-5906-4b31-8b9c-3244be72e03e tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:15.714763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d344d1ce-5906-4b31-8b9c-3244be72e03e tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:15.715199 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d344d1ce-5906-4b31-8b9c-3244be72e03e tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:15.715921 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d344d1ce-5906-4b31-8b9c-3244be72e03e tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:15.716374 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d344d1ce-5906-4b31-8b9c-3244be72e03e tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:15.716797 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d344d1ce-5906-4b31-8b9c-3244be72e03e tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:15.848446 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d344d1ce-5906-4b31-8b9c-3244be72e03e tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:15.856154 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d344d1ce-5906-4b31-8b9c-3244be72e03e tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1504 microversion: 2.1 time: 0.153165 Sep 14 01:06:15.856721 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 121/265] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:15 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:15.902909 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f4e32b61-e7f9-4236-a9e9-5446a7d147ed tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:15.903661 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f4e32b61-e7f9-4236-a9e9-5446a7d147ed tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:15.910185 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f4e32b61-e7f9-4236-a9e9-5446a7d147ed tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:15.910670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f4e32b61-e7f9-4236-a9e9-5446a7d147ed tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:15.911105 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f4e32b61-e7f9-4236-a9e9-5446a7d147ed tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:15.911820 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f4e32b61-e7f9-4236-a9e9-5446a7d147ed tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:15.912278 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f4e32b61-e7f9-4236-a9e9-5446a7d147ed tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:15.912702 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f4e32b61-e7f9-4236-a9e9-5446a7d147ed tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:16.041040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f4e32b61-e7f9-4236-a9e9-5446a7d147ed tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:16.049242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f4e32b61-e7f9-4236-a9e9-5446a7d147ed tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1553 microversion: 2.1 time: 0.150739 Sep 14 01:06:16.049737 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 145/266] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:15 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:16.295237 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-36d7ab5b-af4e-4c14-bbaa-d88c9e55c900 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:16.295864 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-36d7ab5b-af4e-4c14-bbaa-d88c9e55c900 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:16.302702 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-36d7ab5b-af4e-4c14-bbaa-d88c9e55c900 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:16.303109 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-36d7ab5b-af4e-4c14-bbaa-d88c9e55c900 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:16.303540 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-36d7ab5b-af4e-4c14-bbaa-d88c9e55c900 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:16.304241 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-36d7ab5b-af4e-4c14-bbaa-d88c9e55c900 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:16.304691 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-36d7ab5b-af4e-4c14-bbaa-d88c9e55c900 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:16.305109 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-36d7ab5b-af4e-4c14-bbaa-d88c9e55c900 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:16.433861 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-36d7ab5b-af4e-4c14-bbaa-d88c9e55c900 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:16.442214 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-36d7ab5b-af4e-4c14-bbaa-d88c9e55c900 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.150894 Sep 14 01:06:16.442775 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 122/267] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:16 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:16.881399 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fbacfcc4-9661-42c9-9548-d8e71922036b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:16.882003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fbacfcc4-9661-42c9-9548-d8e71922036b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:16.887896 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fbacfcc4-9661-42c9-9548-d8e71922036b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:16.888369 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fbacfcc4-9661-42c9-9548-d8e71922036b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:16.888821 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fbacfcc4-9661-42c9-9548-d8e71922036b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:16.889754 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fbacfcc4-9661-42c9-9548-d8e71922036b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:16.890201 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fbacfcc4-9661-42c9-9548-d8e71922036b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:16.890621 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fbacfcc4-9661-42c9-9548-d8e71922036b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:17.017344 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fbacfcc4-9661-42c9-9548-d8e71922036b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:17.025560 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fbacfcc4-9661-42c9-9548-d8e71922036b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1504 microversion: 2.1 time: 0.149814 Sep 14 01:06:17.026126 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 146/268] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:16 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:17.072577 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2fd42d33-cf1c-4652-9aa7-b14216c13e04 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:17.073181 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2fd42d33-cf1c-4652-9aa7-b14216c13e04 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:17.079276 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2fd42d33-cf1c-4652-9aa7-b14216c13e04 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:17.079800 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2fd42d33-cf1c-4652-9aa7-b14216c13e04 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:17.080241 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2fd42d33-cf1c-4652-9aa7-b14216c13e04 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:17.080931 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2fd42d33-cf1c-4652-9aa7-b14216c13e04 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:17.082003 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2fd42d33-cf1c-4652-9aa7-b14216c13e04 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:17.082513 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2fd42d33-cf1c-4652-9aa7-b14216c13e04 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:17.216649 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-2fd42d33-cf1c-4652-9aa7-b14216c13e04 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:17.225258 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2fd42d33-cf1c-4652-9aa7-b14216c13e04 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1553 microversion: 2.1 time: 0.156442 Sep 14 01:06:17.225811 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 123/269] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:17 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:17.464977 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-010330d6-2d5d-489a-a3f9-79fea90bc337 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:17.465500 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-010330d6-2d5d-489a-a3f9-79fea90bc337 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:17.471523 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-010330d6-2d5d-489a-a3f9-79fea90bc337 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:17.472337 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-010330d6-2d5d-489a-a3f9-79fea90bc337 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:17.472886 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-010330d6-2d5d-489a-a3f9-79fea90bc337 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:17.473578 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-010330d6-2d5d-489a-a3f9-79fea90bc337 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:17.474026 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-010330d6-2d5d-489a-a3f9-79fea90bc337 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:17.474442 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-010330d6-2d5d-489a-a3f9-79fea90bc337 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:17.603760 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-010330d6-2d5d-489a-a3f9-79fea90bc337 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:17.611348 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-010330d6-2d5d-489a-a3f9-79fea90bc337 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.150296 Sep 14 01:06:17.611939 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 147/270] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:17 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:18.049462 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-82fd69cf-8bd3-46ae-ab2a-a18a5157058d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:18.049668 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-82fd69cf-8bd3-46ae-ab2a-a18a5157058d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:18.056000 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-82fd69cf-8bd3-46ae-ab2a-a18a5157058d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:18.056492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-82fd69cf-8bd3-46ae-ab2a-a18a5157058d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:18.056929 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-82fd69cf-8bd3-46ae-ab2a-a18a5157058d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:18.057629 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-82fd69cf-8bd3-46ae-ab2a-a18a5157058d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:18.058088 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-82fd69cf-8bd3-46ae-ab2a-a18a5157058d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:18.058511 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-82fd69cf-8bd3-46ae-ab2a-a18a5157058d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:18.062625 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:18.191539 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-82fd69cf-8bd3-46ae-ab2a-a18a5157058d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:18.199239 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-82fd69cf-8bd3-46ae-ab2a-a18a5157058d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1504 microversion: 2.1 time: 0.154215 Sep 14 01:06:18.199841 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 124/271] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:18 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:18.247791 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c324d1a2-08ac-4e6e-a7e6-664ffdde8703 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:18.248392 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c324d1a2-08ac-4e6e-a7e6-664ffdde8703 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:18.255220 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c324d1a2-08ac-4e6e-a7e6-664ffdde8703 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:18.255730 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c324d1a2-08ac-4e6e-a7e6-664ffdde8703 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:18.256162 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c324d1a2-08ac-4e6e-a7e6-664ffdde8703 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:18.256835 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c324d1a2-08ac-4e6e-a7e6-664ffdde8703 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:18.257281 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c324d1a2-08ac-4e6e-a7e6-664ffdde8703 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:18.257699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c324d1a2-08ac-4e6e-a7e6-664ffdde8703 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:18.385982 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c324d1a2-08ac-4e6e-a7e6-664ffdde8703 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:18.394972 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c324d1a2-08ac-4e6e-a7e6-664ffdde8703 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1553 microversion: 2.1 time: 0.151015 Sep 14 01:06:18.395533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 148/272] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:18 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:18.634425 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d37dfd23-f1ad-4ae5-b249-4363920d5202 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:18.634959 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d37dfd23-f1ad-4ae5-b249-4363920d5202 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:18.641937 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d37dfd23-f1ad-4ae5-b249-4363920d5202 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:18.642675 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d37dfd23-f1ad-4ae5-b249-4363920d5202 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:18.643125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d37dfd23-f1ad-4ae5-b249-4363920d5202 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:18.644479 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d37dfd23-f1ad-4ae5-b249-4363920d5202 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:18.645191 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d37dfd23-f1ad-4ae5-b249-4363920d5202 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:18.645620 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d37dfd23-f1ad-4ae5-b249-4363920d5202 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:18.773661 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d37dfd23-f1ad-4ae5-b249-4363920d5202 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:18.781292 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d37dfd23-f1ad-4ae5-b249-4363920d5202 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.150857 Sep 14 01:06:18.781852 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 125/273] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:18 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:19.222276 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-664fa8f6-4189-4de0-8e0a-64520a486810 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:19.222879 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-664fa8f6-4189-4de0-8e0a-64520a486810 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:19.228735 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-664fa8f6-4189-4de0-8e0a-64520a486810 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:19.229214 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-664fa8f6-4189-4de0-8e0a-64520a486810 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:19.229647 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-664fa8f6-4189-4de0-8e0a-64520a486810 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:19.230324 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-664fa8f6-4189-4de0-8e0a-64520a486810 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:19.230775 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-664fa8f6-4189-4de0-8e0a-64520a486810 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:19.231199 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-664fa8f6-4189-4de0-8e0a-64520a486810 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:19.359166 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-664fa8f6-4189-4de0-8e0a-64520a486810 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:19.367246 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-664fa8f6-4189-4de0-8e0a-64520a486810 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1504 microversion: 2.1 time: 0.148901 Sep 14 01:06:19.367853 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 149/274] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:19 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:19.417625 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-64148006-c4ea-4aa7-a470-827f6266ad61 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:19.418231 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-64148006-c4ea-4aa7-a470-827f6266ad61 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:19.424587 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-64148006-c4ea-4aa7-a470-827f6266ad61 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:19.425310 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-64148006-c4ea-4aa7-a470-827f6266ad61 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:19.425750 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-64148006-c4ea-4aa7-a470-827f6266ad61 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:19.426440 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-64148006-c4ea-4aa7-a470-827f6266ad61 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:19.426895 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-64148006-c4ea-4aa7-a470-827f6266ad61 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:19.427318 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-64148006-c4ea-4aa7-a470-827f6266ad61 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:19.552458 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-64148006-c4ea-4aa7-a470-827f6266ad61 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:19.560552 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-64148006-c4ea-4aa7-a470-827f6266ad61 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1553 microversion: 2.1 time: 0.146745 Sep 14 01:06:19.561118 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 126/275] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:19 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:19.804175 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fce60edb-be13-4e9d-a1ef-52a99ec2457c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:19.804701 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fce60edb-be13-4e9d-a1ef-52a99ec2457c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:19.810540 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fce60edb-be13-4e9d-a1ef-52a99ec2457c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:19.811014 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fce60edb-be13-4e9d-a1ef-52a99ec2457c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:19.811444 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fce60edb-be13-4e9d-a1ef-52a99ec2457c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:19.812161 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fce60edb-be13-4e9d-a1ef-52a99ec2457c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:19.812614 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fce60edb-be13-4e9d-a1ef-52a99ec2457c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:19.813032 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fce60edb-be13-4e9d-a1ef-52a99ec2457c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:19.944894 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fce60edb-be13-4e9d-a1ef-52a99ec2457c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:19.952608 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fce60edb-be13-4e9d-a1ef-52a99ec2457c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.152674 Sep 14 01:06:19.953172 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 150/276] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:19 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:20.390420 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ae137ced-3122-44d4-9584-546063a80d8a tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:20.391024 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ae137ced-3122-44d4-9584-546063a80d8a tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:20.397314 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ae137ced-3122-44d4-9584-546063a80d8a tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:20.397791 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ae137ced-3122-44d4-9584-546063a80d8a tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:20.398225 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ae137ced-3122-44d4-9584-546063a80d8a tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:20.398906 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ae137ced-3122-44d4-9584-546063a80d8a tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:20.399356 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ae137ced-3122-44d4-9584-546063a80d8a tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:20.399802 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ae137ced-3122-44d4-9584-546063a80d8a tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:20.529593 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ae137ced-3122-44d4-9584-546063a80d8a tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:20.537988 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ae137ced-3122-44d4-9584-546063a80d8a tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1504 microversion: 2.1 time: 0.151636 Sep 14 01:06:20.538575 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 127/277] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:20 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:20.584028 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2ea87f0d-22fb-401d-a07e-e4f58a9ae5bb tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:20.584638 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2ea87f0d-22fb-401d-a07e-e4f58a9ae5bb tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:20.590506 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2ea87f0d-22fb-401d-a07e-e4f58a9ae5bb tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:20.590980 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2ea87f0d-22fb-401d-a07e-e4f58a9ae5bb tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:20.591406 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2ea87f0d-22fb-401d-a07e-e4f58a9ae5bb tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:20.592113 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2ea87f0d-22fb-401d-a07e-e4f58a9ae5bb tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:20.592554 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2ea87f0d-22fb-401d-a07e-e4f58a9ae5bb tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:20.592970 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2ea87f0d-22fb-401d-a07e-e4f58a9ae5bb tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:20.722478 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2ea87f0d-22fb-401d-a07e-e4f58a9ae5bb tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:20.731091 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2ea87f0d-22fb-401d-a07e-e4f58a9ae5bb tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1553 microversion: 2.1 time: 0.151249 Sep 14 01:06:20.731697 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 151/278] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:20 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:20.903899 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-2960d42a-ddcc-4029-a239-1c58cc428f92 req-40fb7488-f9cc-4863-861b-a73e4e53b4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449d7479-aa1a-475f-baf9-ecee9f4a52f4", "name": "network-vif-unplugged", "status": "completed", "tag": "9bbe2be7-ebc9-44fb-b5fb-4efec8957ccb"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:06:20.914194 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-2960d42a-ddcc-4029-a239-1c58cc428f92 req-40fb7488-f9cc-4863-861b-a73e4e53b4f6 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:20.914683 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-2960d42a-ddcc-4029-a239-1c58cc428f92 req-40fb7488-f9cc-4863-861b-a73e4e53b4f6 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:20.915119 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-2960d42a-ddcc-4029-a239-1c58cc428f92 req-40fb7488-f9cc-4863-861b-a73e4e53b4f6 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:20.930123 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-2960d42a-ddcc-4029-a239-1c58cc428f92 req-40fb7488-f9cc-4863-861b-a73e4e53b4f6 service nova] Creating event network-vif-unplugged:9bbe2be7-ebc9-44fb-b5fb-4efec8957ccb for instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 on hv-cinder-85752 Sep 14 01:06:20.935027 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-2960d42a-ddcc-4029-a239-1c58cc428f92 req-40fb7488-f9cc-4863-861b-a73e4e53b4f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035375 Sep 14 01:06:20.935652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 128/279] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:06:20.977047 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-dfb5e452-e5da-47be-9402-efbf9d514892 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:20.977656 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-dfb5e452-e5da-47be-9402-efbf9d514892 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:20.983533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dfb5e452-e5da-47be-9402-efbf9d514892 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:20.984048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dfb5e452-e5da-47be-9402-efbf9d514892 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:20.984489 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dfb5e452-e5da-47be-9402-efbf9d514892 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:20.985180 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dfb5e452-e5da-47be-9402-efbf9d514892 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:20.985643 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dfb5e452-e5da-47be-9402-efbf9d514892 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:20.986065 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dfb5e452-e5da-47be-9402-efbf9d514892 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:21.114261 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-dfb5e452-e5da-47be-9402-efbf9d514892 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:21.121952 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-dfb5e452-e5da-47be-9402-efbf9d514892 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.148886 Sep 14 01:06:21.122519 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 152/280] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:20 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:21.562599 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-66657793-e16b-434e-b105-1ab19af62f2e tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:21.563225 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-66657793-e16b-434e-b105-1ab19af62f2e tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:21.569552 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-66657793-e16b-434e-b105-1ab19af62f2e tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:21.570040 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-66657793-e16b-434e-b105-1ab19af62f2e tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:21.570474 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-66657793-e16b-434e-b105-1ab19af62f2e tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:21.571155 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-66657793-e16b-434e-b105-1ab19af62f2e tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:21.571632 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-66657793-e16b-434e-b105-1ab19af62f2e tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:21.572056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-66657793-e16b-434e-b105-1ab19af62f2e tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:21.698786 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-66657793-e16b-434e-b105-1ab19af62f2e tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:21.707193 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-66657793-e16b-434e-b105-1ab19af62f2e tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1504 microversion: 2.1 time: 0.149242 Sep 14 01:06:21.707776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 129/281] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:21 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:21.755187 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c420efe0-0c70-46bc-b798-a35d0570be50 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:21.755821 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c420efe0-0c70-46bc-b798-a35d0570be50 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:21.761791 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c420efe0-0c70-46bc-b798-a35d0570be50 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:21.762275 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c420efe0-0c70-46bc-b798-a35d0570be50 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:21.762709 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c420efe0-0c70-46bc-b798-a35d0570be50 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:21.763396 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c420efe0-0c70-46bc-b798-a35d0570be50 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:21.763885 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c420efe0-0c70-46bc-b798-a35d0570be50 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:21.764568 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c420efe0-0c70-46bc-b798-a35d0570be50 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:21.890487 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c420efe0-0c70-46bc-b798-a35d0570be50 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:21.899154 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c420efe0-0c70-46bc-b798-a35d0570be50 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1553 microversion: 2.1 time: 0.147778 Sep 14 01:06:21.899747 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 153/282] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:21 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:22.145344 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-418082e0-9b82-495f-be73-25c4c4ba8e9a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:22.145886 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-418082e0-9b82-495f-be73-25c4c4ba8e9a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:22.152771 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-418082e0-9b82-495f-be73-25c4c4ba8e9a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:22.153260 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-418082e0-9b82-495f-be73-25c4c4ba8e9a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:22.153691 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-418082e0-9b82-495f-be73-25c4c4ba8e9a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:22.154375 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-418082e0-9b82-495f-be73-25c4c4ba8e9a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:22.154837 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-418082e0-9b82-495f-be73-25c4c4ba8e9a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:22.155318 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-418082e0-9b82-495f-be73-25c4c4ba8e9a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:22.284732 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-418082e0-9b82-495f-be73-25c4c4ba8e9a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:22.292299 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-418082e0-9b82-495f-be73-25c4c4ba8e9a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.150901 Sep 14 01:06:22.292867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 130/283] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:22 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:22.730931 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1f6e6d87-7ac2-41cb-a2a1-8156bc71c24b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:22.731541 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1f6e6d87-7ac2-41cb-a2a1-8156bc71c24b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:22.737617 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1f6e6d87-7ac2-41cb-a2a1-8156bc71c24b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:22.738013 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1f6e6d87-7ac2-41cb-a2a1-8156bc71c24b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:22.738446 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1f6e6d87-7ac2-41cb-a2a1-8156bc71c24b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:22.739128 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1f6e6d87-7ac2-41cb-a2a1-8156bc71c24b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:22.739609 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1f6e6d87-7ac2-41cb-a2a1-8156bc71c24b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:22.740038 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1f6e6d87-7ac2-41cb-a2a1-8156bc71c24b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:22.868596 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1f6e6d87-7ac2-41cb-a2a1-8156bc71c24b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:22.876165 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1f6e6d87-7ac2-41cb-a2a1-8156bc71c24b tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1504 microversion: 2.1 time: 0.149119 Sep 14 01:06:22.876722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 154/284] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:22 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:22.921256 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d166bfe7-ca7e-4517-ae5f-073a03db832f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:22.921871 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d166bfe7-ca7e-4517-ae5f-073a03db832f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:22.928629 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d166bfe7-ca7e-4517-ae5f-073a03db832f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:22.929118 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d166bfe7-ca7e-4517-ae5f-073a03db832f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:22.929557 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d166bfe7-ca7e-4517-ae5f-073a03db832f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:22.930247 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d166bfe7-ca7e-4517-ae5f-073a03db832f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:22.930715 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d166bfe7-ca7e-4517-ae5f-073a03db832f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:22.931136 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d166bfe7-ca7e-4517-ae5f-073a03db832f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:23.063544 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d166bfe7-ca7e-4517-ae5f-073a03db832f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:23.071896 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d166bfe7-ca7e-4517-ae5f-073a03db832f tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1553 microversion: 2.1 time: 0.154414 Sep 14 01:06:23.072471 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 131/285] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:22 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:23.316369 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-aed034b4-6331-435a-b052-5822aabd2576 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:23.317019 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-aed034b4-6331-435a-b052-5822aabd2576 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:23.323148 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aed034b4-6331-435a-b052-5822aabd2576 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:23.323681 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aed034b4-6331-435a-b052-5822aabd2576 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:23.324114 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aed034b4-6331-435a-b052-5822aabd2576 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:23.326126 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aed034b4-6331-435a-b052-5822aabd2576 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:23.326126 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aed034b4-6331-435a-b052-5822aabd2576 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:23.326126 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aed034b4-6331-435a-b052-5822aabd2576 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:23.516679 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-aed034b4-6331-435a-b052-5822aabd2576 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:23.525617 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-aed034b4-6331-435a-b052-5822aabd2576 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.213486 Sep 14 01:06:23.526190 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 155/286] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:23 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:23.902760 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0356ccba-e681-4700-95b6-7d24cdafba40 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:23.903500 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0356ccba-e681-4700-95b6-7d24cdafba40 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:23.910429 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0356ccba-e681-4700-95b6-7d24cdafba40 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:23.910981 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0356ccba-e681-4700-95b6-7d24cdafba40 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:23.911485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0356ccba-e681-4700-95b6-7d24cdafba40 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:23.912268 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0356ccba-e681-4700-95b6-7d24cdafba40 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:23.912796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0356ccba-e681-4700-95b6-7d24cdafba40 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:23.913229 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0356ccba-e681-4700-95b6-7d24cdafba40 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:24.099992 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c0bd58c1-89bb-43b6-aeda-d98f1031498d tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:24.100753 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c0bd58c1-89bb-43b6-aeda-d98f1031498d tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:24.115241 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c0bd58c1-89bb-43b6-aeda-d98f1031498d tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:24.115777 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c0bd58c1-89bb-43b6-aeda-d98f1031498d tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:24.117291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c0bd58c1-89bb-43b6-aeda-d98f1031498d tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:24.117946 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c0bd58c1-89bb-43b6-aeda-d98f1031498d tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:24.118503 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c0bd58c1-89bb-43b6-aeda-d98f1031498d tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:24.119130 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c0bd58c1-89bb-43b6-aeda-d98f1031498d tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:24.183195 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c0bd58c1-89bb-43b6-aeda-d98f1031498d tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:24.192330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c0bd58c1-89bb-43b6-aeda-d98f1031498d tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1511 microversion: 2.1 time: 0.099783 Sep 14 01:06:24.192905 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 156/287] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:24 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1511 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:24.197476 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-2263b3ae-fcfe-4b17-a28f-cb5d9d264fde req-e8ef396c-1895-4a0c-82e2-b2c0933282d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54efdf1e-6204-49c7-9f19-aaeecd377da5", "name": "network-vif-deleted", "tag": "98762bb8-46f5-4fd3-b2c3-8918a3fa0923"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:06:24.207211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-2263b3ae-fcfe-4b17-a28f-cb5d9d264fde req-e8ef396c-1895-4a0c-82e2-b2c0933282d7 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:24.207721 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-2263b3ae-fcfe-4b17-a28f-cb5d9d264fde req-e8ef396c-1895-4a0c-82e2-b2c0933282d7 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:24.208158 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-2263b3ae-fcfe-4b17-a28f-cb5d9d264fde req-e8ef396c-1895-4a0c-82e2-b2c0933282d7 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:24.218987 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-2263b3ae-fcfe-4b17-a28f-cb5d9d264fde req-e8ef396c-1895-4a0c-82e2-b2c0933282d7 service nova] Creating event network-vif-deleted:98762bb8-46f5-4fd3-b2c3-8918a3fa0923 for instance 54efdf1e-6204-49c7-9f19-aaeecd377da5 on hv-cinder-85752 Sep 14 01:06:24.224887 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-2263b3ae-fcfe-4b17-a28f-cb5d9d264fde req-e8ef396c-1895-4a0c-82e2-b2c0933282d7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030853 Sep 14 01:06:24.225987 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 157/288] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:06:24.242992 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0356ccba-e681-4700-95b6-7d24cdafba40 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:24.252441 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0356ccba-e681-4700-95b6-7d24cdafba40 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1504 microversion: 2.1 time: 0.355114 Sep 14 01:06:24.254486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 132/289] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:23 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:24.549333 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-03758b86-ef10-45d4-a7cc-047a4368295f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:24.550299 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-03758b86-ef10-45d4-a7cc-047a4368295f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:24.556432 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-03758b86-ef10-45d4-a7cc-047a4368295f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:24.556908 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-03758b86-ef10-45d4-a7cc-047a4368295f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:24.557345 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-03758b86-ef10-45d4-a7cc-047a4368295f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:24.558113 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-03758b86-ef10-45d4-a7cc-047a4368295f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:24.558584 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-03758b86-ef10-45d4-a7cc-047a4368295f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:24.559007 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-03758b86-ef10-45d4-a7cc-047a4368295f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:24.690569 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-03758b86-ef10-45d4-a7cc-047a4368295f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:24.698309 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-03758b86-ef10-45d4-a7cc-047a4368295f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.153347 Sep 14 01:06:24.698870 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 158/290] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:24 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:25.215298 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-490e446d-520c-473b-95e6-8e307785f7e4 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:25.215852 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-490e446d-520c-473b-95e6-8e307785f7e4 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:25.223049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-490e446d-520c-473b-95e6-8e307785f7e4 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:25.223682 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-490e446d-520c-473b-95e6-8e307785f7e4 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:25.224266 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-490e446d-520c-473b-95e6-8e307785f7e4 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:25.225088 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-490e446d-520c-473b-95e6-8e307785f7e4 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:25.225630 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-490e446d-520c-473b-95e6-8e307785f7e4 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:25.226104 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-490e446d-520c-473b-95e6-8e307785f7e4 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:25.278367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-948ec0a2-922a-4791-b8e9-4118ffa7ac53 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:25.279095 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-948ec0a2-922a-4791-b8e9-4118ffa7ac53 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:25.285554 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-948ec0a2-922a-4791-b8e9-4118ffa7ac53 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:25.286283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-948ec0a2-922a-4791-b8e9-4118ffa7ac53 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:25.286782 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-948ec0a2-922a-4791-b8e9-4118ffa7ac53 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:25.287538 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-948ec0a2-922a-4791-b8e9-4118ffa7ac53 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:25.288092 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-948ec0a2-922a-4791-b8e9-4118ffa7ac53 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:25.288709 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-948ec0a2-922a-4791-b8e9-4118ffa7ac53 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:25.293461 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-490e446d-520c-473b-95e6-8e307785f7e4 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:25.303507 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-490e446d-520c-473b-95e6-8e307785f7e4 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1345 microversion: 2.1 time: 0.092245 Sep 14 01:06:25.304094 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 133/291] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:25 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1345 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:25.322928 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-948ec0a2-922a-4791-b8e9-4118ffa7ac53 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:25.323433 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-948ec0a2-922a-4791-b8e9-4118ffa7ac53 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:25.323895 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-948ec0a2-922a-4791-b8e9-4118ffa7ac53 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:25.324333 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-948ec0a2-922a-4791-b8e9-4118ffa7ac53 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lazy-loading 'fault' on Instance uuid 54efdf1e-6204-49c7-9f19-aaeecd377da5 {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:06:25.371711 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-948ec0a2-922a-4791-b8e9-4118ffa7ac53 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:25.382242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-948ec0a2-922a-4791-b8e9-4118ffa7ac53 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1304 microversion: 2.1 time: 0.107437 Sep 14 01:06:25.383050 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 159/292] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:25 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:25.721137 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8c73a513-8630-44f7-8e01-db8d84c2d463 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:25.721801 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8c73a513-8630-44f7-8e01-db8d84c2d463 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:25.727690 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c73a513-8630-44f7-8e01-db8d84c2d463 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:25.728175 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c73a513-8630-44f7-8e01-db8d84c2d463 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:25.728607 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c73a513-8630-44f7-8e01-db8d84c2d463 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:25.729352 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c73a513-8630-44f7-8e01-db8d84c2d463 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:25.729802 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c73a513-8630-44f7-8e01-db8d84c2d463 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:25.730221 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c73a513-8630-44f7-8e01-db8d84c2d463 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:25.859828 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8c73a513-8630-44f7-8e01-db8d84c2d463 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:25.867993 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8c73a513-8630-44f7-8e01-db8d84c2d463 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1521 microversion: 2.1 time: 0.150629 Sep 14 01:06:25.868590 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 134/293] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:25 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:26.244982 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-0213cf44-98e4-46b3-9714-11e70f1ebf56 req-aab758e4-d765-4572-845b-d72ab29c1c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449d7479-aa1a-475f-baf9-ecee9f4a52f4", "name": "network-vif-deleted", "tag": "9bbe2be7-ebc9-44fb-b5fb-4efec8957ccb"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:06:26.254391 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-0213cf44-98e4-46b3-9714-11e70f1ebf56 req-aab758e4-d765-4572-845b-d72ab29c1c53 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:26.254910 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-0213cf44-98e4-46b3-9714-11e70f1ebf56 req-aab758e4-d765-4572-845b-d72ab29c1c53 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:26.255302 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-0213cf44-98e4-46b3-9714-11e70f1ebf56 req-aab758e4-d765-4572-845b-d72ab29c1c53 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:26.267151 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-0213cf44-98e4-46b3-9714-11e70f1ebf56 req-aab758e4-d765-4572-845b-d72ab29c1c53 service nova] Creating event network-vif-deleted:9bbe2be7-ebc9-44fb-b5fb-4efec8957ccb for instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 on hv-cinder-85752 Sep 14 01:06:26.272498 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-0213cf44-98e4-46b3-9714-11e70f1ebf56 req-aab758e4-d765-4572-845b-d72ab29c1c53 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031123 Sep 14 01:06:26.273084 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 160/294] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:06:26.328150 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-94bf9347-9d83-45dd-9860-c0ecc1bcf246 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:26.328807 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-94bf9347-9d83-45dd-9860-c0ecc1bcf246 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:26.337863 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-94bf9347-9d83-45dd-9860-c0ecc1bcf246 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:26.338561 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-94bf9347-9d83-45dd-9860-c0ecc1bcf246 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:26.339187 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-94bf9347-9d83-45dd-9860-c0ecc1bcf246 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:26.340268 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-94bf9347-9d83-45dd-9860-c0ecc1bcf246 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:26.340882 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-94bf9347-9d83-45dd-9860-c0ecc1bcf246 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:26.341412 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-94bf9347-9d83-45dd-9860-c0ecc1bcf246 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:26.382787 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-94bf9347-9d83-45dd-9860-c0ecc1bcf246 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:26.383506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-94bf9347-9d83-45dd-9860-c0ecc1bcf246 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:26.384268 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-94bf9347-9d83-45dd-9860-c0ecc1bcf246 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:26.384829 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-94bf9347-9d83-45dd-9860-c0ecc1bcf246 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lazy-loading 'fault' on Instance uuid 449d7479-aa1a-475f-baf9-ecee9f4a52f4 {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:06:26.407953 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-828e251b-dd65-4706-b5ca-962a6fb828ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:26.409603 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-828e251b-dd65-4706-b5ca-962a6fb828ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:26.416515 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-828e251b-dd65-4706-b5ca-962a6fb828ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:26.417387 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-828e251b-dd65-4706-b5ca-962a6fb828ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:26.417883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-828e251b-dd65-4706-b5ca-962a6fb828ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:26.418826 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-828e251b-dd65-4706-b5ca-962a6fb828ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:26.419488 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-828e251b-dd65-4706-b5ca-962a6fb828ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:26.419973 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-828e251b-dd65-4706-b5ca-962a6fb828ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:26.441266 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-94bf9347-9d83-45dd-9860-c0ecc1bcf246 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '017a9de44877436fa9531beb756c54c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832072fd5b984b5b91d249c5733452b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:26.451569 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-94bf9347-9d83-45dd-9860-c0ecc1bcf246 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 200 len: 1350 microversion: 2.1 time: 0.127373 Sep 14 01:06:26.463643 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 135/295] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:26 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 1350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:26.464062 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-828e251b-dd65-4706-b5ca-962a6fb828ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:26.464062 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-828e251b-dd65-4706-b5ca-962a6fb828ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:26.464062 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-828e251b-dd65-4706-b5ca-962a6fb828ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:26.464062 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-828e251b-dd65-4706-b5ca-962a6fb828ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lazy-loading 'fault' on Instance uuid 54efdf1e-6204-49c7-9f19-aaeecd377da5 {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:06:26.502266 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-828e251b-dd65-4706-b5ca-962a6fb828ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:26.510850 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-828e251b-dd65-4706-b5ca-962a6fb828ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 200 len: 1304 microversion: 2.1 time: 0.107047 Sep 14 01:06:26.511413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 161/296] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:26 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:26.891071 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9a46a2de-c9d3-4d5f-adfe-60568b7c89d0 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:26.891709 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9a46a2de-c9d3-4d5f-adfe-60568b7c89d0 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:26.898281 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9a46a2de-c9d3-4d5f-adfe-60568b7c89d0 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:26.898760 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9a46a2de-c9d3-4d5f-adfe-60568b7c89d0 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:26.899193 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9a46a2de-c9d3-4d5f-adfe-60568b7c89d0 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:26.899903 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9a46a2de-c9d3-4d5f-adfe-60568b7c89d0 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:26.900357 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9a46a2de-c9d3-4d5f-adfe-60568b7c89d0 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:26.900799 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9a46a2de-c9d3-4d5f-adfe-60568b7c89d0 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:27.031527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9a46a2de-c9d3-4d5f-adfe-60568b7c89d0 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:27.040162 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9a46a2de-c9d3-4d5f-adfe-60568b7c89d0 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1501 microversion: 2.1 time: 0.153197 Sep 14 01:06:27.040719 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 136/297] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:26 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:27.061978 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a9e6198c-5a7d-49b8-9c5c-44e38f3946fe tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:27.062587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a9e6198c-5a7d-49b8-9c5c-44e38f3946fe tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:27.068659 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a9e6198c-5a7d-49b8-9c5c-44e38f3946fe tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:27.069136 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a9e6198c-5a7d-49b8-9c5c-44e38f3946fe tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:27.069567 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a9e6198c-5a7d-49b8-9c5c-44e38f3946fe tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:27.070248 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a9e6198c-5a7d-49b8-9c5c-44e38f3946fe tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:27.070700 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a9e6198c-5a7d-49b8-9c5c-44e38f3946fe tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:27.071122 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a9e6198c-5a7d-49b8-9c5c-44e38f3946fe tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:27.075345 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:27.341784 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a9e6198c-5a7d-49b8-9c5c-44e38f3946fe tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:27.350358 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a9e6198c-5a7d-49b8-9c5c-44e38f3946fe tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1516 microversion: 2.1 time: 0.292165 Sep 14 01:06:27.350916 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 162/298] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:27 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1516 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:27.478936 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-adbedc39-77c0-4a5b-b612-251e0794cb27 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:27.479668 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-adbedc39-77c0-4a5b-b612-251e0794cb27 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:27.486974 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-adbedc39-77c0-4a5b-b612-251e0794cb27 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:27.487900 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-adbedc39-77c0-4a5b-b612-251e0794cb27 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:27.488326 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-adbedc39-77c0-4a5b-b612-251e0794cb27 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:27.489024 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-adbedc39-77c0-4a5b-b612-251e0794cb27 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:27.489473 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-adbedc39-77c0-4a5b-b612-251e0794cb27 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:27.489891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-adbedc39-77c0-4a5b-b612-251e0794cb27 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:27.537448 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9278c487-e466-4aca-86d9-88bc58a1338f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:27.538318 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9278c487-e466-4aca-86d9-88bc58a1338f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 54efdf1e-6204-49c7-9f19-aaeecd377da5] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:27.545211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9278c487-e466-4aca-86d9-88bc58a1338f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:27.545709 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9278c487-e466-4aca-86d9-88bc58a1338f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:27.546193 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9278c487-e466-4aca-86d9-88bc58a1338f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:27.546872 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9278c487-e466-4aca-86d9-88bc58a1338f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:27.547326 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9278c487-e466-4aca-86d9-88bc58a1338f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:27.547774 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9278c487-e466-4aca-86d9-88bc58a1338f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:27.564937 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-9278c487-e466-4aca-86d9-88bc58a1338f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] HTTP exception thrown: Instance 54efdf1e-6204-49c7-9f19-aaeecd377da5 could not be found. Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9278c487-e466-4aca-86d9-88bc58a1338f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Request method failure captured: Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 HTTP/1.1 Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISjtpHSST4FOpvuMaAe36KQPI_KH5sVwJA9V87ybT9QIUm8ACi3YY7S4u-7tGf7jFyJy0M79k3jBF_FqgRPv58xKLzFlNIB9mIJYp_jK5jvAPx8cs-UE0nhrG0I61GtWygSTiysTf7gshDjyZgN7pnjh66VA8POl2R4w96IawnYstBk Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 6df5fe3a39fd4f9fb1ae104e43ec5529 Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-VolumesActionsTest-1201979577 Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:06:27.569994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:06:27.571969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6df5fe3a39fd4f9fb1ae104e43ec5529"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6df5fe3a39fd4f9fb1ae104e43ec5529"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6df5fe3a39fd4f9fb1ae104e43ec5529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6df5fe3a39fd4f9fb1ae104e43ec5529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:06:27.571969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-VolumesActionsTest-1201979577 Sep 14 01:06:27.571969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 6df5fe3a39fd4f9fb1ae104e43ec5529 Sep 14 01:06:27.571969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-VolumesActionsTest-1201979577 Sep 14 01:06:27.571969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-VolumesActionsTest-1201979577-project Sep 14 01:06:27.571969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:06:27.571969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:06:27.571969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: 9bca70e61b80499eb07a668e11534257 Sep 14 01:06:27.571969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-VolumesActionsTest-1201979577-project Sep 14 01:06:27.571969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:06:27.571969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Instance 54efdf1e-6204-49c7-9f19-aaeecd377da5 could not be found. Sep 14 01:06:27.571969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': '54efdf1e-6204-49c7-9f19-aaeecd377da5'} Sep 14 01:06:27.573027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:06:27.573027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:27.573027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:06:27.573027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:06:27.573027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:06:27.573027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:06:27.573027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:06:27.573027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:06:27.573027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:06:27.573027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:06:27.573027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54efdf1e-6204-49c7-9f19-aaeecd377da5 could not be found. Sep 14 01:06:27.573027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:06:27.573027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:06:27.573027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:06:27.573027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:27.573027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:06:27.573027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:06:27.573027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:06:27.573027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:06:27.573027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:06:27.574642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:06:27.574642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:06:27.574642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:06:27.574642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:06:27.574642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:06:27.574642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:06:27.574642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:06:27.574642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54efdf1e-6204-49c7-9f19-aaeecd377da5 could not be found. Sep 14 01:06:27.574642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:06:27.574642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:06:27.574642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:06:27.574642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:27.574642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:06:27.574642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:06:27.574642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:06:27.574642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:06:27.574642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54efdf1e-6204-49c7-9f19-aaeecd377da5 could not be found. Sep 14 01:06:27.574642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:06:27.576173 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9278c487-e466-4aca-86d9-88bc58a1338f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Returning 404 to user: Instance 54efdf1e-6204-49c7-9f19-aaeecd377da5 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:06:27.576173 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9278c487-e466-4aca-86d9-88bc58a1338f tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5" status: 404 len: 111 microversion: 2.1 time: 0.041337 Sep 14 01:06:27.576173 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 163/299] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:27 2022] GET /compute/v2.1/servers/54efdf1e-6204-49c7-9f19-aaeecd377da5 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 01:06:27.661681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-adbedc39-77c0-4a5b-b612-251e0794cb27 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] HTTP exception thrown: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-adbedc39-77c0-4a5b-b612-251e0794cb27 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Request method failure captured: Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 HTTP/1.1 Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISi3y5eVTI3MPUCe1x1R_0kNCKheM2J8bnx8GJQdat-3ruP2aVaiRPGPpOtCmUN_RaJTOnAxv4IXigmL283uPcldyJKASu2vv_qZXfuSUaTYq_QwxzFq_28zPvjBt0azcM-WEFm3zcrgNmVOBGp3nRuGBwkX_AoRXJ1AlOT1WFRIItE Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 832072fd5b984b5b91d249c5733452b8 Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-DeleteServersTestJSON-673149355 Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:06:27.667279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:06:27.668891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/832072fd5b984b5b91d249c5733452b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/832072fd5b984b5b91d249c5733452b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/832072fd5b984b5b91d249c5733452b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_832072fd5b984b5b91d249c5733452b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:06:27.668891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-DeleteServersTestJSON-673149355 Sep 14 01:06:27.668891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 832072fd5b984b5b91d249c5733452b8 Sep 14 01:06:27.668891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-DeleteServersTestJSON-673149355 Sep 14 01:06:27.668891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-DeleteServersTestJSON-673149355-project Sep 14 01:06:27.668891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:06:27.668891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:06:27.668891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: 017a9de44877436fa9531beb756c54c2 Sep 14 01:06:27.668891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-DeleteServersTestJSON-673149355-project Sep 14 01:06:27.668891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:06:27.668891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. Sep 14 01:06:27.668891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': '449d7479-aa1a-475f-baf9-ecee9f4a52f4'} Sep 14 01:06:27.669857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:06:27.669857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:27.669857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:06:27.669857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:06:27.669857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:06:27.669857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:06:27.669857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:06:27.669857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:06:27.669857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:06:27.669857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:06:27.669857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. Sep 14 01:06:27.669857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:06:27.669857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:06:27.669857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:06:27.669857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:27.669857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:06:27.669857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:06:27.669857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:06:27.669857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:06:27.669857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:06:27.671303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:06:27.671303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:06:27.671303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:06:27.671303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:06:27.671303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:06:27.671303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:06:27.671303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:06:27.671303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. Sep 14 01:06:27.671303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:06:27.671303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:06:27.671303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:06:27.671303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:27.671303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:06:27.671303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:06:27.671303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:06:27.671303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:06:27.671303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. Sep 14 01:06:27.671303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:06:27.675308 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-adbedc39-77c0-4a5b-b612-251e0794cb27 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Returning 404 to user: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:06:27.676569 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-adbedc39-77c0-4a5b-b612-251e0794cb27 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 404 len: 111 microversion: 2.1 time: 0.202733 Sep 14 01:06:27.677522 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 137/300] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:27 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:06:27.722833 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5930bd30-69c1-476e-844c-07d647f911a8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2128678471", "imageRef": "a2619027-0d8b-4ca3-9528-1ac3380cab5a", "flavorRef": "452", "networks": [{"uuid": "fb1d7035-fdb4-44fc-a6f7-c8481e97c847"}]}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:06:27.806673 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-5930bd30-69c1-476e-844c-07d647f911a8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] validate_networks() for [('fb1d7035-fdb4-44fc-a6f7-c8481e97c847', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:06:27.863493 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ba501811-8176-4eee-9bf9-8d7286312cac tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:27.866711 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ba501811-8176-4eee-9bf9-8d7286312cac tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:27.874135 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba501811-8176-4eee-9bf9-8d7286312cac tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:27.875254 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba501811-8176-4eee-9bf9-8d7286312cac tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:27.875830 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba501811-8176-4eee-9bf9-8d7286312cac tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:27.876770 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba501811-8176-4eee-9bf9-8d7286312cac tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:27.877371 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba501811-8176-4eee-9bf9-8d7286312cac tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:27.878594 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba501811-8176-4eee-9bf9-8d7286312cac tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:27.894584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-ba501811-8176-4eee-9bf9-8d7286312cac tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] HTTP exception thrown: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ba501811-8176-4eee-9bf9-8d7286312cac tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Request method failure captured: Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4/os-volume_attachments HTTP/1.1 Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISi3y5eVTI3MPUCe1x1R_0kNCKheM2J8bnx8GJQdat-3ruP2aVaiRPGPpOtCmUN_RaJTOnAxv4IXigmL283uPcldyJKASu2vv_qZXfuSUaTYq_QwxzFq_28zPvjBt0azcM-WEFm3zcrgNmVOBGp3nRuGBwkX_AoRXJ1AlOT1WFRIItE Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 832072fd5b984b5b91d249c5733452b8 Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-DeleteServersTestJSON-673149355 Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:06:27.897255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:06:27.898464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/832072fd5b984b5b91d249c5733452b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/832072fd5b984b5b91d249c5733452b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/832072fd5b984b5b91d249c5733452b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_832072fd5b984b5b91d249c5733452b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:06:27.898464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-DeleteServersTestJSON-673149355 Sep 14 01:06:27.898464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 832072fd5b984b5b91d249c5733452b8 Sep 14 01:06:27.898464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-DeleteServersTestJSON-673149355 Sep 14 01:06:27.898464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-DeleteServersTestJSON-673149355-project Sep 14 01:06:27.898464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:06:27.898464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:06:27.898464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: 017a9de44877436fa9531beb756c54c2 Sep 14 01:06:27.898464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-DeleteServersTestJSON-673149355-project Sep 14 01:06:27.898464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:06:27.898464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. Sep 14 01:06:27.898464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'server_id': '449d7479-aa1a-475f-baf9-ecee9f4a52f4'} Sep 14 01:06:27.899130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:06:27.899130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:27.899130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:06:27.899130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:06:27.899130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:06:27.899130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:06:27.899130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:06:27.899130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:06:27.899130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:06:27.899130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:06:27.899130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. Sep 14 01:06:27.899130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:06:27.899130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:06:27.899130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:06:27.899130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:27.899130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:06:27.899130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:06:27.899130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:06:27.899130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:06:27.899130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:06:27.900485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:06:27.900485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 01:06:27.900485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 01:06:27.900485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 01:06:27.900485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 01:06:27.900485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 14 01:06:27.900485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 14 01:06:27.900485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:06:27.900485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:06:27.900485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. Sep 14 01:06:27.900485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:06:27.900485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:06:27.900485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:06:27.900485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:27.900485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:06:27.900485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:06:27.900485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:06:27.900485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:06:27.900485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. Sep 14 01:06:27.900485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:06:27.903203 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ba501811-8176-4eee-9bf9-8d7286312cac tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Returning 404 to user: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:06:27.904419 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ba501811-8176-4eee-9bf9-8d7286312cac tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047623 Sep 14 01:06:27.905791 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 138/301] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 01:06:27 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:06:28.227479 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-5930bd30-69c1-476e-844c-07d647f911a8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:06:28.227928 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-5930bd30-69c1-476e-844c-07d647f911a8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:06:28.228397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-5930bd30-69c1-476e-844c-07d647f911a8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:06:28.228800 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-5930bd30-69c1-476e-844c-07d647f911a8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:06:28.229203 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-5930bd30-69c1-476e-844c-07d647f911a8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:06:28.238477 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5930bd30-69c1-476e-844c-07d647f911a8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:28.238934 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5930bd30-69c1-476e-844c-07d647f911a8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:28.239361 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5930bd30-69c1-476e-844c-07d647f911a8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:28.240122 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5930bd30-69c1-476e-844c-07d647f911a8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:28.240572 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5930bd30-69c1-476e-844c-07d647f911a8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:28.240990 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5930bd30-69c1-476e-844c-07d647f911a8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:28.257649 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-5930bd30-69c1-476e-844c-07d647f911a8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Getting quotas for project 6df5fe3a39fd4f9fb1ae104e43ec5529. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:06:28.261569 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-5930bd30-69c1-476e-844c-07d647f911a8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Getting quotas for user 9bca70e61b80499eb07a668e11534257 and project 6df5fe3a39fd4f9fb1ae104e43ec5529. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:06:28.273164 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5930bd30-69c1-476e-844c-07d647f911a8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:06:28.275443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5930bd30-69c1-476e-844c-07d647f911a8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a2619027-0d8b-4ca3-9528-1ac3380cab5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:06:28.320474 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5930bd30-69c1-476e-844c-07d647f911a8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602718 Sep 14 01:06:28.321103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 164/302] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 01:06:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 01:06:28.332871 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4da0c530-6c0f-4a8b-b2ed-970f2c07bc96 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:28.333582 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4da0c530-6c0f-4a8b-b2ed-970f2c07bc96 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:28.387161 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4da0c530-6c0f-4a8b-b2ed-970f2c07bc96 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:28.396211 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4da0c530-6c0f-4a8b-b2ed-970f2c07bc96 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1214 microversion: 2.1 time: 0.067832 Sep 14 01:06:28.396763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 139/303] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:28 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:28.802686 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-923e30a4-f180-4e6d-abb7-fba72a0176f2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:06:28.804954 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-923e30a4-f180-4e6d-abb7-fba72a0176f2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:28.812197 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-923e30a4-f180-4e6d-abb7-fba72a0176f2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:28.812683 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-923e30a4-f180-4e6d-abb7-fba72a0176f2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:28.813116 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-923e30a4-f180-4e6d-abb7-fba72a0176f2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:28.814796 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-923e30a4-f180-4e6d-abb7-fba72a0176f2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:28.815389 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-923e30a4-f180-4e6d-abb7-fba72a0176f2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:28.815863 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-923e30a4-f180-4e6d-abb7-fba72a0176f2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:28.839347 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-923e30a4-f180-4e6d-abb7-fba72a0176f2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lazy-loading 'flavor' on Instance uuid 96664d10-3eeb-4172-b866-7d824c2310d3 {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:06:28.912833 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-923e30a4-f180-4e6d-abb7-fba72a0176f2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "POST /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3/action" status: 200 len: 32 microversion: 2.1 time: 0.115263 Sep 14 01:06:28.913508 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 165/304] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 01:06:28 2022] POST /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3/action => generated 32 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 01:06:28.922991 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0f388e0b-2aa4-4dd6-9fb7-52ff3857ddb7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:28.923820 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0f388e0b-2aa4-4dd6-9fb7-52ff3857ddb7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:28.932714 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0f388e0b-2aa4-4dd6-9fb7-52ff3857ddb7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:28.933546 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0f388e0b-2aa4-4dd6-9fb7-52ff3857ddb7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:28.934276 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0f388e0b-2aa4-4dd6-9fb7-52ff3857ddb7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:28.935144 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0f388e0b-2aa4-4dd6-9fb7-52ff3857ddb7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:28.935776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0f388e0b-2aa4-4dd6-9fb7-52ff3857ddb7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:28.936348 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0f388e0b-2aa4-4dd6-9fb7-52ff3857ddb7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:29.071918 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0f388e0b-2aa4-4dd6-9fb7-52ff3857ddb7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:29.079535 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0f388e0b-2aa4-4dd6-9fb7-52ff3857ddb7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.160369 Sep 14 01:06:29.080103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 140/305] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:28 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:29.421203 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-dd14f9b9-20d5-43c4-af38-7527e375ed1d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:29.422022 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-dd14f9b9-20d5-43c4-af38-7527e375ed1d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:29.428658 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dd14f9b9-20d5-43c4-af38-7527e375ed1d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:29.429318 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dd14f9b9-20d5-43c4-af38-7527e375ed1d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:29.429967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dd14f9b9-20d5-43c4-af38-7527e375ed1d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:29.430666 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dd14f9b9-20d5-43c4-af38-7527e375ed1d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:29.431123 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dd14f9b9-20d5-43c4-af38-7527e375ed1d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:29.431547 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dd14f9b9-20d5-43c4-af38-7527e375ed1d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:29.506741 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-dd14f9b9-20d5-43c4-af38-7527e375ed1d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:29.514690 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-dd14f9b9-20d5-43c4-af38-7527e375ed1d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1266 microversion: 2.1 time: 0.098453 Sep 14 01:06:29.515241 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 166/306] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:29 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:30.103133 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4f865334-133d-4e6e-af3d-b61921418b01 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:30.103779 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4f865334-133d-4e6e-af3d-b61921418b01 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:30.110191 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4f865334-133d-4e6e-af3d-b61921418b01 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:30.110676 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4f865334-133d-4e6e-af3d-b61921418b01 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:30.111113 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4f865334-133d-4e6e-af3d-b61921418b01 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:30.112505 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4f865334-133d-4e6e-af3d-b61921418b01 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:30.113016 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4f865334-133d-4e6e-af3d-b61921418b01 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:30.113540 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4f865334-133d-4e6e-af3d-b61921418b01 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:30.257982 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4f865334-133d-4e6e-af3d-b61921418b01 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:30.265883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4f865334-133d-4e6e-af3d-b61921418b01 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.166615 Sep 14 01:06:30.266437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 141/307] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:30 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:30.537980 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-11b614c1-ec2d-47ce-977c-65cff065f034 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:30.538584 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-11b614c1-ec2d-47ce-977c-65cff065f034 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:30.544609 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11b614c1-ec2d-47ce-977c-65cff065f034 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:30.545088 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11b614c1-ec2d-47ce-977c-65cff065f034 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:30.545521 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11b614c1-ec2d-47ce-977c-65cff065f034 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:30.546202 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11b614c1-ec2d-47ce-977c-65cff065f034 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:30.546654 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11b614c1-ec2d-47ce-977c-65cff065f034 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:30.547077 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11b614c1-ec2d-47ce-977c-65cff065f034 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:30.619228 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-11b614c1-ec2d-47ce-977c-65cff065f034 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:30.628771 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-11b614c1-ec2d-47ce-977c-65cff065f034 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1266 microversion: 2.1 time: 0.093906 Sep 14 01:06:30.629463 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 167/308] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:30 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:31.291114 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-5c0a7222-fdf2-4f12-a786-19fb8fa9b0f2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:31.291766 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-5c0a7222-fdf2-4f12-a786-19fb8fa9b0f2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:31.305143 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5c0a7222-fdf2-4f12-a786-19fb8fa9b0f2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:31.305143 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5c0a7222-fdf2-4f12-a786-19fb8fa9b0f2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:31.305143 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5c0a7222-fdf2-4f12-a786-19fb8fa9b0f2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:31.305143 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5c0a7222-fdf2-4f12-a786-19fb8fa9b0f2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:31.305472 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5c0a7222-fdf2-4f12-a786-19fb8fa9b0f2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:31.305472 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5c0a7222-fdf2-4f12-a786-19fb8fa9b0f2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:31.446383 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-5c0a7222-fdf2-4f12-a786-19fb8fa9b0f2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:31.454118 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-5c0a7222-fdf2-4f12-a786-19fb8fa9b0f2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.167706 Sep 14 01:06:31.454687 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 142/309] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:31 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:31.654924 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-159538b6-b934-40e2-b662-6042f8fdf031 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:31.655562 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-159538b6-b934-40e2-b662-6042f8fdf031 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:31.664908 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-159538b6-b934-40e2-b662-6042f8fdf031 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:31.665754 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-159538b6-b934-40e2-b662-6042f8fdf031 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:31.666473 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-159538b6-b934-40e2-b662-6042f8fdf031 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:31.667673 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-159538b6-b934-40e2-b662-6042f8fdf031 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:31.668526 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-159538b6-b934-40e2-b662-6042f8fdf031 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:31.668879 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-159538b6-b934-40e2-b662-6042f8fdf031 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:31.741532 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-159538b6-b934-40e2-b662-6042f8fdf031 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:31.749278 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-159538b6-b934-40e2-b662-6042f8fdf031 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1266 microversion: 2.1 time: 0.100487 Sep 14 01:06:31.749840 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 168/310] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:31 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:32.478246 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-cd6ac88f-b469-4a86-ab81-129de7b8881c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:32.478874 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-cd6ac88f-b469-4a86-ab81-129de7b8881c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:32.485371 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cd6ac88f-b469-4a86-ab81-129de7b8881c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:32.485848 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cd6ac88f-b469-4a86-ab81-129de7b8881c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:32.486272 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cd6ac88f-b469-4a86-ab81-129de7b8881c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:32.487849 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cd6ac88f-b469-4a86-ab81-129de7b8881c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:32.488536 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cd6ac88f-b469-4a86-ab81-129de7b8881c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:32.488961 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cd6ac88f-b469-4a86-ab81-129de7b8881c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:32.508105 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=100 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:32.619221 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-cd6ac88f-b469-4a86-ab81-129de7b8881c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:32.626815 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-cd6ac88f-b469-4a86-ab81-129de7b8881c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.152474 Sep 14 01:06:32.627396 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 143/311] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:32 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:32.774622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-df1c1627-e72d-4ea1-b596-44c24826c45d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:32.776041 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-df1c1627-e72d-4ea1-b596-44c24826c45d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:32.783405 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df1c1627-e72d-4ea1-b596-44c24826c45d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:32.784606 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df1c1627-e72d-4ea1-b596-44c24826c45d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:32.785103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df1c1627-e72d-4ea1-b596-44c24826c45d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:32.786060 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df1c1627-e72d-4ea1-b596-44c24826c45d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:32.786573 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df1c1627-e72d-4ea1-b596-44c24826c45d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:32.787091 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df1c1627-e72d-4ea1-b596-44c24826c45d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:32.850523 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-df1c1627-e72d-4ea1-b596-44c24826c45d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:32.859602 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-df1c1627-e72d-4ea1-b596-44c24826c45d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1266 microversion: 2.1 time: 0.088839 Sep 14 01:06:32.860399 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 169/312] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:32 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:33.650592 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-93d95bb9-a0b0-4795-9a18-5091a5331b64 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:33.651390 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-93d95bb9-a0b0-4795-9a18-5091a5331b64 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:33.658714 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-93d95bb9-a0b0-4795-9a18-5091a5331b64 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:33.659356 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-93d95bb9-a0b0-4795-9a18-5091a5331b64 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:33.659819 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-93d95bb9-a0b0-4795-9a18-5091a5331b64 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:33.660524 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-93d95bb9-a0b0-4795-9a18-5091a5331b64 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:33.661035 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-93d95bb9-a0b0-4795-9a18-5091a5331b64 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:33.661473 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-93d95bb9-a0b0-4795-9a18-5091a5331b64 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:33.882200 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-cdcf500d-57cf-42d8-af1f-7ecb8c42bd94 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:33.882813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-cdcf500d-57cf-42d8-af1f-7ecb8c42bd94 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:33.889113 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cdcf500d-57cf-42d8-af1f-7ecb8c42bd94 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:33.889600 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cdcf500d-57cf-42d8-af1f-7ecb8c42bd94 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:33.889854 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-93d95bb9-a0b0-4795-9a18-5091a5331b64 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:33.890034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cdcf500d-57cf-42d8-af1f-7ecb8c42bd94 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:33.890734 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cdcf500d-57cf-42d8-af1f-7ecb8c42bd94 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:33.891189 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cdcf500d-57cf-42d8-af1f-7ecb8c42bd94 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:33.891633 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cdcf500d-57cf-42d8-af1f-7ecb8c42bd94 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:33.899437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-93d95bb9-a0b0-4795-9a18-5091a5331b64 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.252934 Sep 14 01:06:33.911833 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 144/313] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:33 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:33.954558 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cdcf500d-57cf-42d8-af1f-7ecb8c42bd94 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:33.963246 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-cdcf500d-57cf-42d8-af1f-7ecb8c42bd94 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1272 microversion: 2.1 time: 0.084608 Sep 14 01:06:33.963836 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 170/314] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:33 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:34.457950 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2354d9a3-104e-43ff-a220-568d93e27db2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:34.458701 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2354d9a3-104e-43ff-a220-568d93e27db2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:34.460679 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:34.466066 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2354d9a3-104e-43ff-a220-568d93e27db2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:34.466559 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2354d9a3-104e-43ff-a220-568d93e27db2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:34.467015 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2354d9a3-104e-43ff-a220-568d93e27db2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:34.467747 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2354d9a3-104e-43ff-a220-568d93e27db2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:34.468209 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2354d9a3-104e-43ff-a220-568d93e27db2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:34.468644 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2354d9a3-104e-43ff-a220-568d93e27db2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:34.484079 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-2354d9a3-104e-43ff-a220-568d93e27db2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] HTTP exception thrown: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2354d9a3-104e-43ff-a220-568d93e27db2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Request method failure captured: Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: DELETE /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 HTTP/1.1 Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISi3y5eVTI3MPUCe1x1R_0kNCKheM2J8bnx8GJQdat-3ruP2aVaiRPGPpOtCmUN_RaJTOnAxv4IXigmL283uPcldyJKASu2vv_qZXfuSUaTYq_QwxzFq_28zPvjBt0azcM-WEFm3zcrgNmVOBGp3nRuGBwkX_AoRXJ1AlOT1WFRIItE Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 832072fd5b984b5b91d249c5733452b8 Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-DeleteServersTestJSON-673149355 Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:06:34.485804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:06:34.487798 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/832072fd5b984b5b91d249c5733452b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/832072fd5b984b5b91d249c5733452b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/832072fd5b984b5b91d249c5733452b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_832072fd5b984b5b91d249c5733452b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:06:34.487798 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-DeleteServersTestJSON-673149355 Sep 14 01:06:34.487798 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 832072fd5b984b5b91d249c5733452b8 Sep 14 01:06:34.487798 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-DeleteServersTestJSON-673149355 Sep 14 01:06:34.487798 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-DeleteServersTestJSON-673149355-project Sep 14 01:06:34.487798 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:06:34.487798 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:06:34.487798 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: 017a9de44877436fa9531beb756c54c2 Sep 14 01:06:34.487798 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-DeleteServersTestJSON-673149355-project Sep 14 01:06:34.487798 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:06:34.487798 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. Sep 14 01:06:34.487798 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': '449d7479-aa1a-475f-baf9-ecee9f4a52f4'} Sep 14 01:06:34.488656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:06:34.488656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:34.488656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:06:34.488656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:06:34.488656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:06:34.488656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:06:34.488656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:06:34.488656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:06:34.488656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:06:34.488656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:06:34.488656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. Sep 14 01:06:34.488656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:06:34.488656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:06:34.488656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:06:34.488656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:34.488656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:06:34.488656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:06:34.488656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:06:34.488656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:06:34.488656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:06:34.489726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:06:34.489726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 01:06:34.489726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 01:06:34.489726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 01:06:34.489726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 01:06:34.489726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:06:34.489726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:06:34.489726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:06:34.489726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:06:34.489726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. Sep 14 01:06:34.489726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:06:34.489726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:06:34.489726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:06:34.489726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:34.489726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:06:34.489726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:06:34.489726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:06:34.489726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:06:34.489726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. Sep 14 01:06:34.489726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:06:34.490810 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2354d9a3-104e-43ff-a220-568d93e27db2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Returning 404 to user: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:06:34.490810 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2354d9a3-104e-43ff-a220-568d93e27db2 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "DELETE /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 404 len: 111 microversion: 2.1 time: 0.034281 Sep 14 01:06:34.490810 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 145/315] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:06:34 2022] DELETE /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:06:34.498690 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fc774772-56c3-44ff-8f6d-db842527fe22 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:34.499297 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fc774772-56c3-44ff-8f6d-db842527fe22 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] [instance: 449d7479-aa1a-475f-baf9-ecee9f4a52f4] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:34.507019 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fc774772-56c3-44ff-8f6d-db842527fe22 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:34.507675 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fc774772-56c3-44ff-8f6d-db842527fe22 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:34.508175 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fc774772-56c3-44ff-8f6d-db842527fe22 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:34.508968 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fc774772-56c3-44ff-8f6d-db842527fe22 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:34.509481 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fc774772-56c3-44ff-8f6d-db842527fe22 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:34.510219 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fc774772-56c3-44ff-8f6d-db842527fe22 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:34.525841 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-fc774772-56c3-44ff-8f6d-db842527fe22 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] HTTP exception thrown: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fc774772-56c3-44ff-8f6d-db842527fe22 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Request method failure captured: Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 HTTP/1.1 Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISi3y5eVTI3MPUCe1x1R_0kNCKheM2J8bnx8GJQdat-3ruP2aVaiRPGPpOtCmUN_RaJTOnAxv4IXigmL283uPcldyJKASu2vv_qZXfuSUaTYq_QwxzFq_28zPvjBt0azcM-WEFm3zcrgNmVOBGp3nRuGBwkX_AoRXJ1AlOT1WFRIItE Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 832072fd5b984b5b91d249c5733452b8 Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-DeleteServersTestJSON-673149355 Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:06:34.527480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:06:34.528681 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/832072fd5b984b5b91d249c5733452b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/832072fd5b984b5b91d249c5733452b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/832072fd5b984b5b91d249c5733452b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_832072fd5b984b5b91d249c5733452b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:06:34.528681 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-DeleteServersTestJSON-673149355 Sep 14 01:06:34.528681 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 832072fd5b984b5b91d249c5733452b8 Sep 14 01:06:34.528681 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-DeleteServersTestJSON-673149355 Sep 14 01:06:34.528681 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-DeleteServersTestJSON-673149355-project Sep 14 01:06:34.528681 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:06:34.528681 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:06:34.528681 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: 017a9de44877436fa9531beb756c54c2 Sep 14 01:06:34.528681 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-DeleteServersTestJSON-673149355-project Sep 14 01:06:34.528681 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:06:34.528681 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. Sep 14 01:06:34.528681 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': '449d7479-aa1a-475f-baf9-ecee9f4a52f4'} Sep 14 01:06:34.529367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:06:34.529367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:34.529367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:06:34.529367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:06:34.529367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:06:34.529367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:06:34.529367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:06:34.529367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:06:34.529367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:06:34.529367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:06:34.529367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. Sep 14 01:06:34.529367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:06:34.529367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:06:34.529367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:06:34.529367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:34.529367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:06:34.529367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:06:34.529367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:06:34.529367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:06:34.529367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:06:34.530557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:06:34.530557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:06:34.530557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:06:34.530557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:06:34.530557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:06:34.530557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:06:34.530557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:06:34.530557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. Sep 14 01:06:34.530557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:06:34.530557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:06:34.530557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:06:34.530557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:34.530557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:06:34.530557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:06:34.530557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:06:34.530557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:06:34.530557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. Sep 14 01:06:34.530557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:06:34.531631 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fc774772-56c3-44ff-8f6d-db842527fe22 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] Returning 404 to user: Instance 449d7479-aa1a-475f-baf9-ecee9f4a52f4 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:06:34.531631 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fc774772-56c3-44ff-8f6d-db842527fe22 tempest-DeleteServersTestJSON-673149355 tempest-DeleteServersTestJSON-673149355-project] 10.222.0.42 "GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4" status: 404 len: 111 microversion: 2.1 time: 0.035813 Sep 14 01:06:34.531631 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 171/316] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:34 2022] GET /compute/v2.1/servers/449d7479-aa1a-475f-baf9-ecee9f4a52f4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:06:34.830584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-ce45955d-caf5-4d53-b9c0-53fb1a43e555 req-48fc096b-e041-4bcb-8cc5-a6a0e8d3af0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3baa270c-fed4-45ed-b3c2-bec6c36b92b3", "tag": "3ca2b5fe-47ef-4179-97e0-8c0f3dede52b"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:06:34.843177 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-ce45955d-caf5-4d53-b9c0-53fb1a43e555 req-48fc096b-e041-4bcb-8cc5-a6a0e8d3af0e service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:34.843674 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-ce45955d-caf5-4d53-b9c0-53fb1a43e555 req-48fc096b-e041-4bcb-8cc5-a6a0e8d3af0e service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:34.844282 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-ce45955d-caf5-4d53-b9c0-53fb1a43e555 req-48fc096b-e041-4bcb-8cc5-a6a0e8d3af0e service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:34.857952 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-ce45955d-caf5-4d53-b9c0-53fb1a43e555 req-48fc096b-e041-4bcb-8cc5-a6a0e8d3af0e service nova] Creating event network-changed:3ca2b5fe-47ef-4179-97e0-8c0f3dede52b for instance 3baa270c-fed4-45ed-b3c2-bec6c36b92b3 on hv-cinder-85752 Sep 14 01:06:34.864353 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-ce45955d-caf5-4d53-b9c0-53fb1a43e555 req-48fc096b-e041-4bcb-8cc5-a6a0e8d3af0e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038778 Sep 14 01:06:34.864948 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 146/317] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:06:34.927041 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-139cf70f-dfcd-4e68-93fa-0f02efffd0f3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:34.930422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-139cf70f-dfcd-4e68-93fa-0f02efffd0f3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:34.936674 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-139cf70f-dfcd-4e68-93fa-0f02efffd0f3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:34.937078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-139cf70f-dfcd-4e68-93fa-0f02efffd0f3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:34.937508 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-139cf70f-dfcd-4e68-93fa-0f02efffd0f3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:34.938402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-139cf70f-dfcd-4e68-93fa-0f02efffd0f3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:34.938852 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-139cf70f-dfcd-4e68-93fa-0f02efffd0f3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:34.939321 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-139cf70f-dfcd-4e68-93fa-0f02efffd0f3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:34.987791 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e0e34e27-64e3-4e52-a5c9-1d29dfa02ce8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:34.988857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-e0e34e27-64e3-4e52-a5c9-1d29dfa02ce8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:34.996376 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e0e34e27-64e3-4e52-a5c9-1d29dfa02ce8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:34.996888 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e0e34e27-64e3-4e52-a5c9-1d29dfa02ce8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:34.997327 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e0e34e27-64e3-4e52-a5c9-1d29dfa02ce8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:34.998018 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e0e34e27-64e3-4e52-a5c9-1d29dfa02ce8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:34.998652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e0e34e27-64e3-4e52-a5c9-1d29dfa02ce8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:34.999285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e0e34e27-64e3-4e52-a5c9-1d29dfa02ce8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:35.242375 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e0e34e27-64e3-4e52-a5c9-1d29dfa02ce8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:35.250662 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-e0e34e27-64e3-4e52-a5c9-1d29dfa02ce8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1314 microversion: 2.1 time: 0.267652 Sep 14 01:06:35.251349 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 147/318] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:34 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:35.396548 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-139cf70f-dfcd-4e68-93fa-0f02efffd0f3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:35.404330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-139cf70f-dfcd-4e68-93fa-0f02efffd0f3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.482695 Sep 14 01:06:35.404885 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 172/319] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:34 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:36.276715 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e7c5f563-1c1d-4aeb-9abf-9582b16e1be3 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:36.277238 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-e7c5f563-1c1d-4aeb-9abf-9582b16e1be3 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:36.284677 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e7c5f563-1c1d-4aeb-9abf-9582b16e1be3 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:36.285345 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e7c5f563-1c1d-4aeb-9abf-9582b16e1be3 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:36.285787 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e7c5f563-1c1d-4aeb-9abf-9582b16e1be3 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:36.286486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e7c5f563-1c1d-4aeb-9abf-9582b16e1be3 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:36.286958 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e7c5f563-1c1d-4aeb-9abf-9582b16e1be3 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:36.287366 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e7c5f563-1c1d-4aeb-9abf-9582b16e1be3 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:36.426974 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e7c5f563-1c1d-4aeb-9abf-9582b16e1be3 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:36.430473 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c62f680e-a66b-4225-9f1f-2c6208a577eb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:36.432388 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c62f680e-a66b-4225-9f1f-2c6208a577eb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:36.435423 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-e7c5f563-1c1d-4aeb-9abf-9582b16e1be3 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1314 microversion: 2.1 time: 0.162563 Sep 14 01:06:36.436039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 148/320] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:36 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:36.441474 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c62f680e-a66b-4225-9f1f-2c6208a577eb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:36.442039 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c62f680e-a66b-4225-9f1f-2c6208a577eb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:36.442606 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c62f680e-a66b-4225-9f1f-2c6208a577eb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:36.443385 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c62f680e-a66b-4225-9f1f-2c6208a577eb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:36.443924 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c62f680e-a66b-4225-9f1f-2c6208a577eb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:36.444545 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c62f680e-a66b-4225-9f1f-2c6208a577eb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:36.661443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c62f680e-a66b-4225-9f1f-2c6208a577eb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:36.671294 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c62f680e-a66b-4225-9f1f-2c6208a577eb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.246835 Sep 14 01:06:36.671926 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 173/321] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:36 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:37.459733 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2be57653-7acf-47ae-8f7a-003f6e0418ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:37.460303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2be57653-7acf-47ae-8f7a-003f6e0418ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:37.467027 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2be57653-7acf-47ae-8f7a-003f6e0418ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:37.468029 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2be57653-7acf-47ae-8f7a-003f6e0418ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:37.469163 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2be57653-7acf-47ae-8f7a-003f6e0418ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:37.470031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2be57653-7acf-47ae-8f7a-003f6e0418ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:37.470628 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2be57653-7acf-47ae-8f7a-003f6e0418ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:37.471366 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2be57653-7acf-47ae-8f7a-003f6e0418ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:37.683794 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-2be57653-7acf-47ae-8f7a-003f6e0418ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:37.694333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2be57653-7acf-47ae-8f7a-003f6e0418ee tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1314 microversion: 2.1 time: 0.238903 Sep 14 01:06:37.695285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 149/322] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:37 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:37.696289 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0ab0878a-b9e2-4a97-a540-7f53eb78ca20 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:37.696983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0ab0878a-b9e2-4a97-a540-7f53eb78ca20 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:37.705783 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ab0878a-b9e2-4a97-a540-7f53eb78ca20 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:37.706349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ab0878a-b9e2-4a97-a540-7f53eb78ca20 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:37.707136 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ab0878a-b9e2-4a97-a540-7f53eb78ca20 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:37.708652 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ab0878a-b9e2-4a97-a540-7f53eb78ca20 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:37.709467 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ab0878a-b9e2-4a97-a540-7f53eb78ca20 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:37.710180 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0ab0878a-b9e2-4a97-a540-7f53eb78ca20 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:37.862304 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0ab0878a-b9e2-4a97-a540-7f53eb78ca20 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:37.871208 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0ab0878a-b9e2-4a97-a540-7f53eb78ca20 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.180525 Sep 14 01:06:37.872374 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 174/323] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:37 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:38.717128 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-01ea3d9c-f915-4e73-a199-28966dd735d9 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:38.717735 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-01ea3d9c-f915-4e73-a199-28966dd735d9 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:38.720911 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=2 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:38.725931 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-01ea3d9c-f915-4e73-a199-28966dd735d9 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:38.726421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-01ea3d9c-f915-4e73-a199-28966dd735d9 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:38.726856 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-01ea3d9c-f915-4e73-a199-28966dd735d9 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:38.727572 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-01ea3d9c-f915-4e73-a199-28966dd735d9 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:38.728023 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-01ea3d9c-f915-4e73-a199-28966dd735d9 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:38.728437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-01ea3d9c-f915-4e73-a199-28966dd735d9 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:38.894917 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fb827b48-c62a-497d-9ce3-71d85d2bdd86 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:38.895521 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fb827b48-c62a-497d-9ce3-71d85d2bdd86 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:38.897530 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:38.898178 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=6 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:38.900132 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:38.904960 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fb827b48-c62a-497d-9ce3-71d85d2bdd86 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:38.905442 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fb827b48-c62a-497d-9ce3-71d85d2bdd86 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:38.905877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fb827b48-c62a-497d-9ce3-71d85d2bdd86 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:38.906574 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fb827b48-c62a-497d-9ce3-71d85d2bdd86 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:38.907031 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fb827b48-c62a-497d-9ce3-71d85d2bdd86 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:38.907455 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fb827b48-c62a-497d-9ce3-71d85d2bdd86 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:38.949874 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-01ea3d9c-f915-4e73-a199-28966dd735d9 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:38.965218 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-01ea3d9c-f915-4e73-a199-28966dd735d9 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1314 microversion: 2.1 time: 0.250346 Sep 14 01:06:38.967722 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 150/324] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:38 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:39.089910 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fb827b48-c62a-497d-9ce3-71d85d2bdd86 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:39.098629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fb827b48-c62a-497d-9ce3-71d85d2bdd86 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.208014 Sep 14 01:06:39.099198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 175/325] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:38 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:39.990529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-1c9cbb9b-7c5b-4f5d-b9dd-e48198c3fcad tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:39.991295 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-1c9cbb9b-7c5b-4f5d-b9dd-e48198c3fcad tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:39.999585 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1c9cbb9b-7c5b-4f5d-b9dd-e48198c3fcad tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:40.000271 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1c9cbb9b-7c5b-4f5d-b9dd-e48198c3fcad tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:40.001036 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1c9cbb9b-7c5b-4f5d-b9dd-e48198c3fcad tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:40.002816 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1c9cbb9b-7c5b-4f5d-b9dd-e48198c3fcad tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:40.003879 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1c9cbb9b-7c5b-4f5d-b9dd-e48198c3fcad tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:40.004373 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1c9cbb9b-7c5b-4f5d-b9dd-e48198c3fcad tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:40.127719 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ba5ede79-b1e0-4977-8867-1ab1f6967ab7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:40.131033 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ba5ede79-b1e0-4977-8867-1ab1f6967ab7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:40.146474 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ba5ede79-b1e0-4977-8867-1ab1f6967ab7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:40.148124 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ba5ede79-b1e0-4977-8867-1ab1f6967ab7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:40.148941 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ba5ede79-b1e0-4977-8867-1ab1f6967ab7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:40.155298 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ba5ede79-b1e0-4977-8867-1ab1f6967ab7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:40.156116 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ba5ede79-b1e0-4977-8867-1ab1f6967ab7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:40.156750 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ba5ede79-b1e0-4977-8867-1ab1f6967ab7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:40.171493 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-1c9cbb9b-7c5b-4f5d-b9dd-e48198c3fcad tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:40.180905 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-1c9cbb9b-7c5b-4f5d-b9dd-e48198c3fcad tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1314 microversion: 2.1 time: 0.194703 Sep 14 01:06:40.182036 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 151/326] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:39 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:40.309254 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ba5ede79-b1e0-4977-8867-1ab1f6967ab7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:40.317699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ba5ede79-b1e0-4977-8867-1ab1f6967ab7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.199435 Sep 14 01:06:40.318253 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 176/327] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:40 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:41.206172 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-17cc6d79-4629-40a6-851c-f571186dfd00 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:41.207516 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-17cc6d79-4629-40a6-851c-f571186dfd00 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:41.214735 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17cc6d79-4629-40a6-851c-f571186dfd00 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:41.215259 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17cc6d79-4629-40a6-851c-f571186dfd00 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:41.215911 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17cc6d79-4629-40a6-851c-f571186dfd00 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:41.216823 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17cc6d79-4629-40a6-851c-f571186dfd00 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:41.217524 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17cc6d79-4629-40a6-851c-f571186dfd00 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:41.217957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17cc6d79-4629-40a6-851c-f571186dfd00 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:41.230498 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c06473c7-9444-4a77-81b4-2292eb850a95 tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] Calling method '.version_select at 0x7f5043f37c10>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:41.293274 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c06473c7-9444-4a77-81b4-2292eb850a95 tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/1d481a8a-2969-4498-9d55-0bb87b353752" status: 200 len: 351 microversion: 2.1 time: 0.066494 Sep 14 01:06:41.294571 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 177/328] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 01:06:41 2022] GET /compute/v2.1/os-volumes/1d481a8a-2969-4498-9d55-0bb87b353752 => generated 351 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:06:41.342289 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1b8fbf7b-86e3-4797-b800-b13c040a58d4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:41.343182 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1b8fbf7b-86e3-4797-b800-b13c040a58d4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:41.353930 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1b8fbf7b-86e3-4797-b800-b13c040a58d4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:41.355498 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1b8fbf7b-86e3-4797-b800-b13c040a58d4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:41.356167 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1b8fbf7b-86e3-4797-b800-b13c040a58d4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:41.357705 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1b8fbf7b-86e3-4797-b800-b13c040a58d4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:41.358722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1b8fbf7b-86e3-4797-b800-b13c040a58d4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:41.359398 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1b8fbf7b-86e3-4797-b800-b13c040a58d4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:41.388084 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-17cc6d79-4629-40a6-851c-f571186dfd00 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:41.399684 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-17cc6d79-4629-40a6-851c-f571186dfd00 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1314 microversion: 2.1 time: 0.197941 Sep 14 01:06:41.400623 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 152/329] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:41 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:41.598856 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1b8fbf7b-86e3-4797-b800-b13c040a58d4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:41.609885 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1b8fbf7b-86e3-4797-b800-b13c040a58d4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.272690 Sep 14 01:06:41.610606 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 178/330] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:41 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:42.423138 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-44aace4c-0f92-4bc5-9ce4-f7f7b220882d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:42.424474 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-44aace4c-0f92-4bc5-9ce4-f7f7b220882d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:42.430959 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-44aace4c-0f92-4bc5-9ce4-f7f7b220882d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:42.431443 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-44aace4c-0f92-4bc5-9ce4-f7f7b220882d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:42.431925 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-44aace4c-0f92-4bc5-9ce4-f7f7b220882d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:42.432635 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-44aace4c-0f92-4bc5-9ce4-f7f7b220882d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:42.433090 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-44aace4c-0f92-4bc5-9ce4-f7f7b220882d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:42.433548 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-44aace4c-0f92-4bc5-9ce4-f7f7b220882d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:42.561019 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-44aace4c-0f92-4bc5-9ce4-f7f7b220882d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:42.568866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-44aace4c-0f92-4bc5-9ce4-f7f7b220882d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1314 microversion: 2.1 time: 0.149623 Sep 14 01:06:42.569424 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 153/331] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:42 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:42.639513 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f588efd0-67f2-4a9f-9299-f2fc92def6a8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:42.640149 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f588efd0-67f2-4a9f-9299-f2fc92def6a8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:42.647105 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f588efd0-67f2-4a9f-9299-f2fc92def6a8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:42.647657 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f588efd0-67f2-4a9f-9299-f2fc92def6a8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:42.648172 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f588efd0-67f2-4a9f-9299-f2fc92def6a8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:42.648860 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f588efd0-67f2-4a9f-9299-f2fc92def6a8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:42.649309 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f588efd0-67f2-4a9f-9299-f2fc92def6a8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:42.649727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f588efd0-67f2-4a9f-9299-f2fc92def6a8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:42.698985 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-32a11422-63ac-4681-9e87-8a6b98c1dbb1 tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] Calling method '.version_select at 0x7f50481bed30>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:42.747682 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-32a11422-63ac-4681-9e87-8a6b98c1dbb1 tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/a6a90c78-7cc7-46d5-bc8a-2869733ad7e4" status: 200 len: 351 microversion: 2.1 time: 0.052478 Sep 14 01:06:42.748243 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 154/332] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 01:06:42 2022] GET /compute/v2.1/os-volumes/a6a90c78-7cc7-46d5-bc8a-2869733ad7e4 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:06:42.791027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f588efd0-67f2-4a9f-9299-f2fc92def6a8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:42.794440 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:42.799841 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f588efd0-67f2-4a9f-9299-f2fc92def6a8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.164347 Sep 14 01:06:42.800405 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 179/333] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:42 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:43.188721 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-9d285f5f-a0c8-4c44-8711-6667dae1b8fe req-303caf7b-6981-4d25-8786-503f3c69a0f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3baa270c-fed4-45ed-b3c2-bec6c36b92b3", "name": "network-vif-plugged", "status": "completed", "tag": "3ca2b5fe-47ef-4179-97e0-8c0f3dede52b"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:06:43.199153 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-9d285f5f-a0c8-4c44-8711-6667dae1b8fe req-303caf7b-6981-4d25-8786-503f3c69a0f5 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:43.199876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-9d285f5f-a0c8-4c44-8711-6667dae1b8fe req-303caf7b-6981-4d25-8786-503f3c69a0f5 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:43.200401 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-9d285f5f-a0c8-4c44-8711-6667dae1b8fe req-303caf7b-6981-4d25-8786-503f3c69a0f5 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:43.217238 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-9d285f5f-a0c8-4c44-8711-6667dae1b8fe req-303caf7b-6981-4d25-8786-503f3c69a0f5 service nova] Creating event network-vif-plugged:3ca2b5fe-47ef-4179-97e0-8c0f3dede52b for instance 3baa270c-fed4-45ed-b3c2-bec6c36b92b3 on hv-cinder-85752 Sep 14 01:06:43.222971 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-9d285f5f-a0c8-4c44-8711-6667dae1b8fe req-303caf7b-6981-4d25-8786-503f3c69a0f5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038144 Sep 14 01:06:43.223587 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 155/334] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:06:43.592616 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f50b009f-d0ef-4799-8f51-0e317539ced8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:43.593225 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f50b009f-d0ef-4799-8f51-0e317539ced8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:43.601416 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f50b009f-d0ef-4799-8f51-0e317539ced8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:43.601944 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f50b009f-d0ef-4799-8f51-0e317539ced8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:43.602484 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f50b009f-d0ef-4799-8f51-0e317539ced8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:43.603203 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f50b009f-d0ef-4799-8f51-0e317539ced8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:43.603687 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f50b009f-d0ef-4799-8f51-0e317539ced8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:43.604121 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f50b009f-d0ef-4799-8f51-0e317539ced8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:43.732682 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f50b009f-d0ef-4799-8f51-0e317539ced8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:43.740317 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f50b009f-d0ef-4799-8f51-0e317539ced8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1314 microversion: 2.1 time: 0.152010 Sep 14 01:06:43.740877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 180/335] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:43 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:43.824444 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-b4c2c594-35c5-4c7c-ad1e-13b145669481 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:43.825244 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-b4c2c594-35c5-4c7c-ad1e-13b145669481 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:43.832525 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b4c2c594-35c5-4c7c-ad1e-13b145669481 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:43.833042 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b4c2c594-35c5-4c7c-ad1e-13b145669481 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:43.833582 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b4c2c594-35c5-4c7c-ad1e-13b145669481 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:43.834274 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b4c2c594-35c5-4c7c-ad1e-13b145669481 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:43.834731 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b4c2c594-35c5-4c7c-ad1e-13b145669481 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:43.835176 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b4c2c594-35c5-4c7c-ad1e-13b145669481 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:43.981941 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b4c2c594-35c5-4c7c-ad1e-13b145669481 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:43.990844 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-b4c2c594-35c5-4c7c-ad1e-13b145669481 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.171408 Sep 14 01:06:43.991359 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 156/336] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:43 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:44.085130 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-85ae3784-0395-4796-b7eb-a6a3413287eb tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] Calling method '.version_select at 0x7f5043f37310>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:44.131228 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-85ae3784-0395-4796-b7eb-a6a3413287eb tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f363b9a7-2622-4b08-811b-c22580eacee6" status: 200 len: 350 microversion: 2.1 time: 0.050149 Sep 14 01:06:44.131832 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 181/337] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 01:06:44 2022] GET /compute/v2.1/os-volumes/f363b9a7-2622-4b08-811b-c22580eacee6 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:06:44.145449 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-75288efe-f961-4274-85c8-f6b68ba757ff tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] Calling method '.version_select at 0x7f50480721f0>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:44.234544 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-75288efe-f961-4274-85c8-f6b68ba757ff tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.093306 Sep 14 01:06:44.235210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 157/338] 10.222.0.42 () {58 vars in 1134 bytes} [Wed Sep 14 01:06:44 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:44.250036 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fe857ef2-2777-4fcb-89e4-aa513e43c38b tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] Calling method '.version_select at 0x7f5043f2d3a0>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:44.338893 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fe857ef2-2777-4fcb-89e4-aa513e43c38b tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092581 Sep 14 01:06:44.339452 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 182/339] 10.222.0.42 () {58 vars in 1149 bytes} [Wed Sep 14 01:06:44 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:06:44.354994 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-26b9528c-8e8f-40a9-a967-5a7ca16b8908 tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] Calling method '.version_select at 0x7f5048161820>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:44.363072 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-53506ea0-b5e8-43d6-809e-4a1a9fa1843d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-177359778", "imageRef": "a2619027-0d8b-4ca3-9528-1ac3380cab5a", "flavorRef": "452", "networks": [{"uuid": "3dab046e-a732-4523-8b50-a5cba6b7830d"}]}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:06:44.419943 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-53506ea0-b5e8-43d6-809e-4a1a9fa1843d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] validate_networks() for [('3dab046e-a732-4523-8b50-a5cba6b7830d', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:06:44.440627 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-26b9528c-8e8f-40a9-a967-5a7ca16b8908 tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090008 Sep 14 01:06:44.441203 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 158/340] 10.222.0.42 () {58 vars in 1134 bytes} [Wed Sep 14 01:06:44 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:44.458302 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-aa5b3fc9-e725-449e-bdaf-8c4172b4c15c tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] Calling method '.version_select at 0x7f5048096820>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:44.545344 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-aa5b3fc9-e725-449e-bdaf-8c4172b4c15c tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092521 Sep 14 01:06:44.545918 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 159/341] 10.222.0.42 () {58 vars in 1167 bytes} [Wed Sep 14 01:06:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:06:44.559947 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-160087d8-907b-469d-8f9f-dc020ebbc95e tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] Calling method '.version_select at 0x7f5043fe34c0>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:44.646254 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-160087d8-907b-469d-8f9f-dc020ebbc95e tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089859 Sep 14 01:06:44.646995 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 160/342] 10.222.0.42 () {58 vars in 1170 bytes} [Wed Sep 14 01:06:44 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:06:44.662502 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4a2f9efb-3cb4-4672-8e6b-a1931d4c0232 tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] Calling method '.version_select at 0x7f5048072af0>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:44.748988 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4a2f9efb-3cb4-4672-8e6b-a1931d4c0232 tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.091520 Sep 14 01:06:44.749564 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 161/343] 10.222.0.42 () {58 vars in 1155 bytes} [Wed Sep 14 01:06:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:44.764211 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0ba0afb9-613d-4f76-9a70-d80fcfb197f8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:44.764832 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0ba0afb9-613d-4f76-9a70-d80fcfb197f8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:44.772380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0ba0afb9-613d-4f76-9a70-d80fcfb197f8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:44.773076 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0ba0afb9-613d-4f76-9a70-d80fcfb197f8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:44.773526 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0ba0afb9-613d-4f76-9a70-d80fcfb197f8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:44.774235 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0ba0afb9-613d-4f76-9a70-d80fcfb197f8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:44.774699 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0ba0afb9-613d-4f76-9a70-d80fcfb197f8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:44.775127 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0ba0afb9-613d-4f76-9a70-d80fcfb197f8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:44.793433 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-53506ea0-b5e8-43d6-809e-4a1a9fa1843d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:06:44.793903 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-53506ea0-b5e8-43d6-809e-4a1a9fa1843d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:06:44.794309 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-53506ea0-b5e8-43d6-809e-4a1a9fa1843d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:06:44.794705 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-53506ea0-b5e8-43d6-809e-4a1a9fa1843d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:06:44.795104 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-53506ea0-b5e8-43d6-809e-4a1a9fa1843d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:06:44.804624 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53506ea0-b5e8-43d6-809e-4a1a9fa1843d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:44.805099 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53506ea0-b5e8-43d6-809e-4a1a9fa1843d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:44.805528 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53506ea0-b5e8-43d6-809e-4a1a9fa1843d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:44.806239 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53506ea0-b5e8-43d6-809e-4a1a9fa1843d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:44.806690 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53506ea0-b5e8-43d6-809e-4a1a9fa1843d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:44.807106 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53506ea0-b5e8-43d6-809e-4a1a9fa1843d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:44.826085 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-53506ea0-b5e8-43d6-809e-4a1a9fa1843d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Getting quotas for project 0f8eb4de1820448eb1064b0fbb45a259. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:06:44.830058 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-53506ea0-b5e8-43d6-809e-4a1a9fa1843d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Getting quotas for user 0b9c17d96f3d44589cee145c8ec2e97d and project 0f8eb4de1820448eb1064b0fbb45a259. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:06:44.841423 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-53506ea0-b5e8-43d6-809e-4a1a9fa1843d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:06:44.843733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-53506ea0-b5e8-43d6-809e-4a1a9fa1843d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a2619027-0d8b-4ca3-9528-1ac3380cab5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:06:44.893611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-53506ea0-b5e8-43d6-809e-4a1a9fa1843d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534839 Sep 14 01:06:44.894255 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 183/344] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 01:06:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 01:06:44.898958 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-99e5446c-21ba-457a-acaa-d367288b961c tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] Calling method '.version_select at 0x7f5043f37700>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:44.918646 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0ba0afb9-613d-4f76-9a70-d80fcfb197f8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:44.928244 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0ba0afb9-613d-4f76-9a70-d80fcfb197f8 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1314 microversion: 2.1 time: 0.168250 Sep 14 01:06:44.929749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 162/345] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:44 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:44.934266 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4f638747-c9c9-436c-9be2-933aa29731b8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:44.934972 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4f638747-c9c9-436c-9be2-933aa29731b8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:44.991632 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4f638747-c9c9-436c-9be2-933aa29731b8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:44.999067 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4f638747-c9c9-436c-9be2-933aa29731b8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1218 microversion: 2.1 time: 0.068666 Sep 14 01:06:44.999854 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 163/346] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:44 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:45.016587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-99e5446c-21ba-457a-acaa-d367288b961c tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.121209 Sep 14 01:06:45.017898 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 184/347] 10.222.0.42 () {58 vars in 1188 bytes} [Wed Sep 14 01:06:44 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:06:45.019003 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8db3a419-8977-4b3a-9733-0674a71e8b60 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:45.019676 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8db3a419-8977-4b3a-9733-0674a71e8b60 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:45.027913 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8db3a419-8977-4b3a-9733-0674a71e8b60 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:45.027913 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8db3a419-8977-4b3a-9733-0674a71e8b60 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:45.028323 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8db3a419-8977-4b3a-9733-0674a71e8b60 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:45.028945 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8db3a419-8977-4b3a-9733-0674a71e8b60 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:45.029416 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8db3a419-8977-4b3a-9733-0674a71e8b60 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:45.029833 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8db3a419-8977-4b3a-9733-0674a71e8b60 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:45.032731 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1527ce3f-9e9e-4d30-959e-4568bfaeff5a tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] Calling method '.version_select at 0x7f5043f2d4c0>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:45.183185 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8db3a419-8977-4b3a-9733-0674a71e8b60 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:45.195454 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8db3a419-8977-4b3a-9733-0674a71e8b60 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.184212 Sep 14 01:06:45.196880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 164/348] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:45 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:45.291873 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1527ce3f-9e9e-4d30-959e-4568bfaeff5a tempest-VolumesTestJSON-1752719498 tempest-VolumesTestJSON-1752719498-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.262762 Sep 14 01:06:45.292463 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 185/349] 10.222.0.42 () {58 vars in 1155 bytes} [Wed Sep 14 01:06:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:45.952775 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-38345a13-53c1-4454-ab0e-fddbc05984f3 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:45.953523 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-38345a13-53c1-4454-ab0e-fddbc05984f3 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:45.960344 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-38345a13-53c1-4454-ab0e-fddbc05984f3 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:45.960833 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-38345a13-53c1-4454-ab0e-fddbc05984f3 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:45.961271 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-38345a13-53c1-4454-ab0e-fddbc05984f3 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:45.961968 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-38345a13-53c1-4454-ab0e-fddbc05984f3 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:45.962424 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-38345a13-53c1-4454-ab0e-fddbc05984f3 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:45.962869 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-38345a13-53c1-4454-ab0e-fddbc05984f3 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:46.024165 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-31eeb9e8-673e-45db-a7d9-ceb268963950 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:46.024781 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-31eeb9e8-673e-45db-a7d9-ceb268963950 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:46.031820 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-31eeb9e8-673e-45db-a7d9-ceb268963950 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:46.032407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-31eeb9e8-673e-45db-a7d9-ceb268963950 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:46.032906 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-31eeb9e8-673e-45db-a7d9-ceb268963950 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:46.034234 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-31eeb9e8-673e-45db-a7d9-ceb268963950 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:46.034752 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-31eeb9e8-673e-45db-a7d9-ceb268963950 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:46.035243 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-31eeb9e8-673e-45db-a7d9-ceb268963950 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:46.098396 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-31eeb9e8-673e-45db-a7d9-ceb268963950 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:46.101569 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-38345a13-53c1-4454-ab0e-fddbc05984f3 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:46.105980 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-31eeb9e8-673e-45db-a7d9-ceb268963950 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1214 microversion: 2.1 time: 0.086086 Sep 14 01:06:46.106630 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 186/350] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:46 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:46.109332 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-38345a13-53c1-4454-ab0e-fddbc05984f3 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1498 microversion: 2.1 time: 0.160448 Sep 14 01:06:46.109890 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 165/351] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:45 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:46.221593 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ab4945b7-42f0-46ba-929c-5d847ce865c9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:46.222408 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ab4945b7-42f0-46ba-929c-5d847ce865c9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:46.228237 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab4945b7-42f0-46ba-929c-5d847ce865c9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:46.228722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab4945b7-42f0-46ba-929c-5d847ce865c9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:46.229147 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab4945b7-42f0-46ba-929c-5d847ce865c9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:46.229925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab4945b7-42f0-46ba-929c-5d847ce865c9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:46.230378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab4945b7-42f0-46ba-929c-5d847ce865c9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:46.230791 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab4945b7-42f0-46ba-929c-5d847ce865c9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:46.372511 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ab4945b7-42f0-46ba-929c-5d847ce865c9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:46.380809 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ab4945b7-42f0-46ba-929c-5d847ce865c9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.164631 Sep 14 01:06:46.381380 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 187/352] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:46 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:46.785733 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e184cf51-3e7a-44d7-8ef5-8c58aff3db92 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:46.786425 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-e184cf51-3e7a-44d7-8ef5-8c58aff3db92 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:46.793271 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e184cf51-3e7a-44d7-8ef5-8c58aff3db92 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:46.793821 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e184cf51-3e7a-44d7-8ef5-8c58aff3db92 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:46.794222 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e184cf51-3e7a-44d7-8ef5-8c58aff3db92 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:46.794913 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e184cf51-3e7a-44d7-8ef5-8c58aff3db92 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:46.795371 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e184cf51-3e7a-44d7-8ef5-8c58aff3db92 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:46.795831 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e184cf51-3e7a-44d7-8ef5-8c58aff3db92 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:46.822903 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-e184cf51-3e7a-44d7-8ef5-8c58aff3db92 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Going to try to terminate instance {{(pid=120620) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:06:46.905709 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-e184cf51-3e7a-44d7-8ef5-8c58aff3db92 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 204 len: 0 microversion: 2.1 time: 0.124255 Sep 14 01:06:46.906368 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 166/353] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:06:46 2022] DELETE /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 01:06:46.915253 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c65e2241-6283-4e70-8de1-30bb5420d33d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:46.915907 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c65e2241-6283-4e70-8de1-30bb5420d33d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:46.921921 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c65e2241-6283-4e70-8de1-30bb5420d33d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:46.922403 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c65e2241-6283-4e70-8de1-30bb5420d33d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:46.922838 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c65e2241-6283-4e70-8de1-30bb5420d33d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:46.923596 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c65e2241-6283-4e70-8de1-30bb5420d33d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:46.924068 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c65e2241-6283-4e70-8de1-30bb5420d33d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:46.924489 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c65e2241-6283-4e70-8de1-30bb5420d33d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:47.057560 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c65e2241-6283-4e70-8de1-30bb5420d33d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:47.065520 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c65e2241-6283-4e70-8de1-30bb5420d33d tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1504 microversion: 2.1 time: 0.154528 Sep 14 01:06:47.066096 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 188/354] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:46 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:47.131211 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8c36abfa-528a-4c88-8b4a-34e30d9c5c23 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:47.132078 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8c36abfa-528a-4c88-8b4a-34e30d9c5c23 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:47.138102 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c36abfa-528a-4c88-8b4a-34e30d9c5c23 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:47.138590 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c36abfa-528a-4c88-8b4a-34e30d9c5c23 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:47.139277 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c36abfa-528a-4c88-8b4a-34e30d9c5c23 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:47.140005 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c36abfa-528a-4c88-8b4a-34e30d9c5c23 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:47.140458 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c36abfa-528a-4c88-8b4a-34e30d9c5c23 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:47.140884 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c36abfa-528a-4c88-8b4a-34e30d9c5c23 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:47.160972 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:47.207899 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8c36abfa-528a-4c88-8b4a-34e30d9c5c23 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:47.215702 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8c36abfa-528a-4c88-8b4a-34e30d9c5c23 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1214 microversion: 2.1 time: 0.089503 Sep 14 01:06:47.216344 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 167/355] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:47 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:47.404778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-47063c4d-1842-40cc-8ace-974bfc42b417 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:47.405567 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-47063c4d-1842-40cc-8ace-974bfc42b417 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:47.413032 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47063c4d-1842-40cc-8ace-974bfc42b417 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:47.413818 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47063c4d-1842-40cc-8ace-974bfc42b417 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:47.414348 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47063c4d-1842-40cc-8ace-974bfc42b417 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:47.415142 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47063c4d-1842-40cc-8ace-974bfc42b417 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:47.415726 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47063c4d-1842-40cc-8ace-974bfc42b417 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:47.416384 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47063c4d-1842-40cc-8ace-974bfc42b417 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:47.559946 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-47063c4d-1842-40cc-8ace-974bfc42b417 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:47.568777 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-47063c4d-1842-40cc-8ace-974bfc42b417 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.167911 Sep 14 01:06:47.569407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 189/356] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:47 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:48.089446 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6ac121f7-0e49-49a4-883e-206aa43b1c81 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:48.090062 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-6ac121f7-0e49-49a4-883e-206aa43b1c81 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:48.097414 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6ac121f7-0e49-49a4-883e-206aa43b1c81 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:48.097893 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6ac121f7-0e49-49a4-883e-206aa43b1c81 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:48.098335 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6ac121f7-0e49-49a4-883e-206aa43b1c81 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:48.099029 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6ac121f7-0e49-49a4-883e-206aa43b1c81 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:48.099491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6ac121f7-0e49-49a4-883e-206aa43b1c81 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:48.099942 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6ac121f7-0e49-49a4-883e-206aa43b1c81 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:48.238029 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6ac121f7-0e49-49a4-883e-206aa43b1c81 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:48.240934 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-15380472-639b-4a94-addb-5531b54322b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:48.241546 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-15380472-639b-4a94-addb-5531b54322b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:48.247320 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-6ac121f7-0e49-49a4-883e-206aa43b1c81 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1504 microversion: 2.1 time: 0.161792 Sep 14 01:06:48.247960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 168/357] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:48 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:48.248111 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-15380472-639b-4a94-addb-5531b54322b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:48.248505 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-15380472-639b-4a94-addb-5531b54322b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:48.249060 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-15380472-639b-4a94-addb-5531b54322b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:48.249758 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-15380472-639b-4a94-addb-5531b54322b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:48.250208 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-15380472-639b-4a94-addb-5531b54322b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:48.250629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-15380472-639b-4a94-addb-5531b54322b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:48.313734 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-15380472-639b-4a94-addb-5531b54322b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:48.321711 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-15380472-639b-4a94-addb-5531b54322b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1214 microversion: 2.1 time: 0.086300 Sep 14 01:06:48.322272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 190/358] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:48 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:48.591899 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2f50b98a-654d-48f3-9ae5-4e5d9194595b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:48.592458 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2f50b98a-654d-48f3-9ae5-4e5d9194595b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:48.599341 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2f50b98a-654d-48f3-9ae5-4e5d9194595b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:48.600249 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2f50b98a-654d-48f3-9ae5-4e5d9194595b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:48.600463 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2f50b98a-654d-48f3-9ae5-4e5d9194595b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:48.601347 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2f50b98a-654d-48f3-9ae5-4e5d9194595b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:48.601888 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2f50b98a-654d-48f3-9ae5-4e5d9194595b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:48.602368 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2f50b98a-654d-48f3-9ae5-4e5d9194595b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:48.749938 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-2f50b98a-654d-48f3-9ae5-4e5d9194595b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:48.758680 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2f50b98a-654d-48f3-9ae5-4e5d9194595b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.170710 Sep 14 01:06:48.759265 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 169/359] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:48 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:49.271513 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-54c05972-a9bb-4e94-bb4a-735ba450baf4 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:49.272433 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-54c05972-a9bb-4e94-bb4a-735ba450baf4 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:49.279272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54c05972-a9bb-4e94-bb4a-735ba450baf4 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:49.279860 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54c05972-a9bb-4e94-bb4a-735ba450baf4 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:49.280356 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54c05972-a9bb-4e94-bb4a-735ba450baf4 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:49.281131 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54c05972-a9bb-4e94-bb4a-735ba450baf4 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:49.281647 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54c05972-a9bb-4e94-bb4a-735ba450baf4 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:49.282135 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54c05972-a9bb-4e94-bb4a-735ba450baf4 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:49.344365 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4906a471-4d8b-4e1c-a634-db1643d5361d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:49.344897 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4906a471-4d8b-4e1c-a634-db1643d5361d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:49.351836 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4906a471-4d8b-4e1c-a634-db1643d5361d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:49.352327 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4906a471-4d8b-4e1c-a634-db1643d5361d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:49.352766 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4906a471-4d8b-4e1c-a634-db1643d5361d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:49.353461 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4906a471-4d8b-4e1c-a634-db1643d5361d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:49.353916 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4906a471-4d8b-4e1c-a634-db1643d5361d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:49.354338 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4906a471-4d8b-4e1c-a634-db1643d5361d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:49.423977 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4906a471-4d8b-4e1c-a634-db1643d5361d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:49.432816 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4906a471-4d8b-4e1c-a634-db1643d5361d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1270 microversion: 2.1 time: 0.092288 Sep 14 01:06:49.448451 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 170/360] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:49 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1270 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:49.465181 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-54c05972-a9bb-4e94-bb4a-735ba450baf4 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:49.475362 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-54c05972-a9bb-4e94-bb4a-735ba450baf4 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1504 microversion: 2.1 time: 0.208411 Sep 14 01:06:49.476066 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 191/361] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:49 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1504 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:49.782107 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-fb17569e-9648-42bf-95f9-e1c99803f1e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:49.783518 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-fb17569e-9648-42bf-95f9-e1c99803f1e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:49.790010 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fb17569e-9648-42bf-95f9-e1c99803f1e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:49.790603 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fb17569e-9648-42bf-95f9-e1c99803f1e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:49.791129 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fb17569e-9648-42bf-95f9-e1c99803f1e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:49.791873 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fb17569e-9648-42bf-95f9-e1c99803f1e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:49.792333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fb17569e-9648-42bf-95f9-e1c99803f1e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:49.792765 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fb17569e-9648-42bf-95f9-e1c99803f1e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:49.937979 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-fb17569e-9648-42bf-95f9-e1c99803f1e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:49.947843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-fb17569e-9648-42bf-95f9-e1c99803f1e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.169629 Sep 14 01:06:49.948499 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 171/362] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:49 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:50.459196 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8e596b3a-eca6-4328-8525-6f4008478f8e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:50.459954 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8e596b3a-eca6-4328-8525-6f4008478f8e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:50.467532 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8e596b3a-eca6-4328-8525-6f4008478f8e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:50.468635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8e596b3a-eca6-4328-8525-6f4008478f8e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:50.469528 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8e596b3a-eca6-4328-8525-6f4008478f8e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:50.470683 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8e596b3a-eca6-4328-8525-6f4008478f8e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:50.471674 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8e596b3a-eca6-4328-8525-6f4008478f8e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:50.472448 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8e596b3a-eca6-4328-8525-6f4008478f8e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:50.502227 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-3f250f77-9de2-4538-abad-cba4133c3526 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:50.503504 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-3f250f77-9de2-4538-abad-cba4133c3526 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:50.516750 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3f250f77-9de2-4538-abad-cba4133c3526 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:50.517810 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3f250f77-9de2-4538-abad-cba4133c3526 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:50.518440 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3f250f77-9de2-4538-abad-cba4133c3526 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:50.519489 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3f250f77-9de2-4538-abad-cba4133c3526 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:50.520498 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3f250f77-9de2-4538-abad-cba4133c3526 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:50.521120 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3f250f77-9de2-4538-abad-cba4133c3526 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:50.575664 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8e596b3a-eca6-4328-8525-6f4008478f8e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:50.588585 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8e596b3a-eca6-4328-8525-6f4008478f8e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1270 microversion: 2.1 time: 0.134959 Sep 14 01:06:50.589458 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 192/363] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:50 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1270 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:50.788038 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-3f250f77-9de2-4538-abad-cba4133c3526 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:50.800644 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-3f250f77-9de2-4538-abad-cba4133c3526 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1504 microversion: 2.1 time: 0.302556 Sep 14 01:06:50.801689 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 172/364] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:50 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1504 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:50.982178 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7c121e7c-b49e-4d17-a972-af2b12dbfffc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:50.983237 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7c121e7c-b49e-4d17-a972-af2b12dbfffc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:50.995139 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c121e7c-b49e-4d17-a972-af2b12dbfffc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:50.995878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c121e7c-b49e-4d17-a972-af2b12dbfffc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:50.999249 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c121e7c-b49e-4d17-a972-af2b12dbfffc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:51.000680 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c121e7c-b49e-4d17-a972-af2b12dbfffc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:51.001285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c121e7c-b49e-4d17-a972-af2b12dbfffc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:51.003212 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c121e7c-b49e-4d17-a972-af2b12dbfffc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:51.106765 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-3dfff4f6-acfb-494c-9afe-c70ba09d3602 req-56bf0b2a-a01b-4d73-8302-38ad9beb4d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3baa270c-fed4-45ed-b3c2-bec6c36b92b3", "name": "network-vif-deleted", "tag": "3ca2b5fe-47ef-4179-97e0-8c0f3dede52b"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:06:51.121106 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-3dfff4f6-acfb-494c-9afe-c70ba09d3602 req-56bf0b2a-a01b-4d73-8302-38ad9beb4d5d service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:51.121965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-3dfff4f6-acfb-494c-9afe-c70ba09d3602 req-56bf0b2a-a01b-4d73-8302-38ad9beb4d5d service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:51.122775 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-3dfff4f6-acfb-494c-9afe-c70ba09d3602 req-56bf0b2a-a01b-4d73-8302-38ad9beb4d5d service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:51.139361 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-3dfff4f6-acfb-494c-9afe-c70ba09d3602 req-56bf0b2a-a01b-4d73-8302-38ad9beb4d5d service nova] Creating event network-vif-deleted:3ca2b5fe-47ef-4179-97e0-8c0f3dede52b for instance 3baa270c-fed4-45ed-b3c2-bec6c36b92b3 on hv-cinder-85752 Sep 14 01:06:51.146948 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-3dfff4f6-acfb-494c-9afe-c70ba09d3602 req-56bf0b2a-a01b-4d73-8302-38ad9beb4d5d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042930 Sep 14 01:06:51.148274 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 173/365] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:06:51.234438 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7c121e7c-b49e-4d17-a972-af2b12dbfffc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:51.244467 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7c121e7c-b49e-4d17-a972-af2b12dbfffc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.267616 Sep 14 01:06:51.245124 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 193/366] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:50 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:51.612324 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9a0c6501-4d22-41d1-8bb6-f2010d1e4876 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:51.613447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9a0c6501-4d22-41d1-8bb6-f2010d1e4876 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:51.625927 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9a0c6501-4d22-41d1-8bb6-f2010d1e4876 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:51.626902 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9a0c6501-4d22-41d1-8bb6-f2010d1e4876 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:51.627524 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9a0c6501-4d22-41d1-8bb6-f2010d1e4876 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:51.628474 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9a0c6501-4d22-41d1-8bb6-f2010d1e4876 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:51.628975 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9a0c6501-4d22-41d1-8bb6-f2010d1e4876 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:51.629374 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9a0c6501-4d22-41d1-8bb6-f2010d1e4876 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:51.719352 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9a0c6501-4d22-41d1-8bb6-f2010d1e4876 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:51.728645 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9a0c6501-4d22-41d1-8bb6-f2010d1e4876 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1278 microversion: 2.1 time: 0.121110 Sep 14 01:06:51.729473 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 174/367] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:51 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1278 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:51.828736 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3427c711-7fcb-4012-bd45-087daf0d3bbe tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:51.830538 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3427c711-7fcb-4012-bd45-087daf0d3bbe tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:51.848469 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3427c711-7fcb-4012-bd45-087daf0d3bbe tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:51.848947 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3427c711-7fcb-4012-bd45-087daf0d3bbe tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:51.849381 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3427c711-7fcb-4012-bd45-087daf0d3bbe tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:51.850435 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3427c711-7fcb-4012-bd45-087daf0d3bbe tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:51.851699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3427c711-7fcb-4012-bd45-087daf0d3bbe tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:51.852198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3427c711-7fcb-4012-bd45-087daf0d3bbe tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:51.893210 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3427c711-7fcb-4012-bd45-087daf0d3bbe tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:51.894093 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3427c711-7fcb-4012-bd45-087daf0d3bbe tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:51.894783 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3427c711-7fcb-4012-bd45-087daf0d3bbe tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:51.895462 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-3427c711-7fcb-4012-bd45-087daf0d3bbe tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lazy-loading 'fault' on Instance uuid 3baa270c-fed4-45ed-b3c2-bec6c36b92b3 {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:06:51.960757 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3427c711-7fcb-4012-bd45-087daf0d3bbe tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:51.976772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3427c711-7fcb-4012-bd45-087daf0d3bbe tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1304 microversion: 2.1 time: 0.153265 Sep 14 01:06:51.977747 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 194/368] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:51 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1304 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:52.270122 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-acfd7730-38de-4ccc-b3b0-3745bb970643 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:52.270965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-acfd7730-38de-4ccc-b3b0-3745bb970643 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:52.278616 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-acfd7730-38de-4ccc-b3b0-3745bb970643 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:52.279930 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-acfd7730-38de-4ccc-b3b0-3745bb970643 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:52.280953 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-acfd7730-38de-4ccc-b3b0-3745bb970643 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:52.282295 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-acfd7730-38de-4ccc-b3b0-3745bb970643 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:52.283041 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-acfd7730-38de-4ccc-b3b0-3745bb970643 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:52.283866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-acfd7730-38de-4ccc-b3b0-3745bb970643 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:52.617414 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-acfd7730-38de-4ccc-b3b0-3745bb970643 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:52.627502 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-acfd7730-38de-4ccc-b3b0-3745bb970643 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1502 microversion: 2.1 time: 0.361525 Sep 14 01:06:52.628309 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 175/369] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:52 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1502 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:52.653082 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5671b360-b955-406d-8cf3-6e5aa3d5ca08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f360621d-98a7-40ca-a594-f1a1b3775b99"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:06:52.656091 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5671b360-b955-406d-8cf3-6e5aa3d5ca08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:52.677144 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5671b360-b955-406d-8cf3-6e5aa3d5ca08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:52.678007 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5671b360-b955-406d-8cf3-6e5aa3d5ca08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:52.678650 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5671b360-b955-406d-8cf3-6e5aa3d5ca08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:52.679463 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5671b360-b955-406d-8cf3-6e5aa3d5ca08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:52.680007 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5671b360-b955-406d-8cf3-6e5aa3d5ca08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:52.680825 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5671b360-b955-406d-8cf3-6e5aa3d5ca08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:52.713735 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-5671b360-b955-406d-8cf3-6e5aa3d5ca08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] HTTP exception thrown: Cannot 'attach_volume' instance 96664d10-3eeb-4172-b866-7d824c2310d3 while it is in vm_state rescued Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5671b360-b955-406d-8cf3-6e5aa3d5ca08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Request method failure captured: Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: POST /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3/os-volume_attachments HTTP/1.1 Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 74 Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISi4inilP69TsQy2mm8Nh_IJQUYwZWgS8ICnEm1cj-smaP8bvo3DYC3hiD1vyg0oqkoMty-SG5kNH82xGIxyRzyUFloa1yf9CprF8FrUKT4AVz69xJpjqpXzcwegWPCIyPFW48HXkwwHrds38MJBEzqTje22LXfjItqk1TH9fQ_CyxA Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: d1dd868f069a46dbb6bfd549f6bbf7b8 Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2000797838 Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:06:52.715727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:06:52.717622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1dd868f069a46dbb6bfd549f6bbf7b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1dd868f069a46dbb6bfd549f6bbf7b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1dd868f069a46dbb6bfd549f6bbf7b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1dd868f069a46dbb6bfd549f6bbf7b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:06:52.717622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2000797838 Sep 14 01:06:52.717622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: d1dd868f069a46dbb6bfd549f6bbf7b8 Sep 14 01:06:52.717622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2000797838 Sep 14 01:06:52.717622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-ServerRescueNegativeTestJSON-2000797838-project Sep 14 01:06:52.717622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:06:52.717622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:06:52.717622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: bf73eca572454b88843785d791f0b471 Sep 14 01:06:52.717622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2000797838-project Sep 14 01:06:52.717622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Sep 14 01:06:52.717622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {"volumeAttachment": {"volumeId": "f360621d-98a7-40ca-a594-f1a1b3775b99"}} Sep 14 01:06:52.717622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:06:52.718627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Cannot 'attach_volume' instance 96664d10-3eeb-4172-b866-7d824c2310d3 while it is in vm_state rescued Sep 14 01:06:52.718627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'server_id': '96664d10-3eeb-4172-b866-7d824c2310d3', 'body': {'volumeAttachment': {'volumeId': 'f360621d-98a7-40ca-a594-f1a1b3775b99'}}} Sep 14 01:06:52.718627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:06:52.718627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:52.718627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 14 01:06:52.718627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 14 01:06:52.718627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 01:06:52.718627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 01:06:52.718627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 01:06:52.718627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 01:06:52.718627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 96664d10-3eeb-4172-b866-7d824c2310d3 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 14 01:06:52.718627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:06:52.718627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:06:52.718627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:06:52.718627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:52.718627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:06:52.718627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:06:52.718627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:06:52.718627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:06:52.721273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:06:52.721273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:06:52.721273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 01:06:52.721273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 01:06:52.721273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 01:06:52.721273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 01:06:52.721273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 01:06:52.721273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 01:06:52.721273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 14 01:06:52.721273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 01:06:52.721273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 01:06:52.721273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 01:06:52.721273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 96664d10-3eeb-4172-b866-7d824c2310d3 while it is in vm_state rescued Sep 14 01:06:52.721273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:06:52.721273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:06:52.721273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:06:52.721273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:52.721273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:06:52.721273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:06:52.722954 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:06:52.722954 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:06:52.722954 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 96664d10-3eeb-4172-b866-7d824c2310d3 while it is in vm_state rescued Sep 14 01:06:52.722954 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:06:52.722954 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5671b360-b955-406d-8cf3-6e5aa3d5ca08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Returning 409 to user: Cannot 'attach_volume' instance 96664d10-3eeb-4172-b866-7d824c2310d3 while it is in vm_state rescued {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:06:52.722954 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5671b360-b955-406d-8cf3-6e5aa3d5ca08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "POST /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.069319 Sep 14 01:06:52.722954 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 195/370] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 01:06:52 2022] POST /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3/os-volume_attachments => generated 152 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 01:06:52.729775 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-230ee953-8b6c-44d5-a833-a6134ec089ad tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:06:52.730318 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-230ee953-8b6c-44d5-a833-a6134ec089ad tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:52.739115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-230ee953-8b6c-44d5-a833-a6134ec089ad tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:52.739846 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-230ee953-8b6c-44d5-a833-a6134ec089ad tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:52.740291 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-230ee953-8b6c-44d5-a833-a6134ec089ad tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:52.741020 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-230ee953-8b6c-44d5-a833-a6134ec089ad tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:52.746462 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-230ee953-8b6c-44d5-a833-a6134ec089ad tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:52.749868 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-230ee953-8b6c-44d5-a833-a6134ec089ad tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:52.753012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e713986c-968e-4275-a53f-cea5c5a271d3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:52.753635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e713986c-968e-4275-a53f-cea5c5a271d3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:52.765737 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e713986c-968e-4275-a53f-cea5c5a271d3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:52.766379 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e713986c-968e-4275-a53f-cea5c5a271d3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:52.766911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e713986c-968e-4275-a53f-cea5c5a271d3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:52.768340 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e713986c-968e-4275-a53f-cea5c5a271d3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:52.768918 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e713986c-968e-4275-a53f-cea5c5a271d3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:52.769454 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e713986c-968e-4275-a53f-cea5c5a271d3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:52.852022 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-230ee953-8b6c-44d5-a833-a6134ec089ad tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "POST /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3/action" status: 202 len: 0 microversion: 2.1 time: 0.126019 Sep 14 01:06:52.853178 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 176/371] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 01:06:52 2022] POST /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:06:52.857857 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e713986c-968e-4275-a53f-cea5c5a271d3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:52.862112 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-1034d7d7-5152-48dd-a195-692cf0f35fe5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:52.864373 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-1034d7d7-5152-48dd-a195-692cf0f35fe5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:52.867786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e713986c-968e-4275-a53f-cea5c5a271d3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1276 microversion: 2.1 time: 0.119001 Sep 14 01:06:52.869012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 196/372] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:52 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1276 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:52.875026 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1034d7d7-5152-48dd-a195-692cf0f35fe5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:52.875528 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1034d7d7-5152-48dd-a195-692cf0f35fe5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:52.876008 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1034d7d7-5152-48dd-a195-692cf0f35fe5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:52.877240 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1034d7d7-5152-48dd-a195-692cf0f35fe5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:52.877731 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1034d7d7-5152-48dd-a195-692cf0f35fe5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:52.878152 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1034d7d7-5152-48dd-a195-692cf0f35fe5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:53.002439 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-39ea0d5c-8b6d-4470-923e-960ce0f540ba tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:53.003284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-39ea0d5c-8b6d-4470-923e-960ce0f540ba tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:53.013311 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-39ea0d5c-8b6d-4470-923e-960ce0f540ba tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:53.016622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-39ea0d5c-8b6d-4470-923e-960ce0f540ba tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:53.018540 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-39ea0d5c-8b6d-4470-923e-960ce0f540ba tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:53.019707 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-39ea0d5c-8b6d-4470-923e-960ce0f540ba tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:53.020977 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-39ea0d5c-8b6d-4470-923e-960ce0f540ba tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:53.022672 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-39ea0d5c-8b6d-4470-923e-960ce0f540ba tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:53.067329 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-39ea0d5c-8b6d-4470-923e-960ce0f540ba tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:53.068390 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-39ea0d5c-8b6d-4470-923e-960ce0f540ba tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:53.069347 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-39ea0d5c-8b6d-4470-923e-960ce0f540ba tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:53.070046 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-39ea0d5c-8b6d-4470-923e-960ce0f540ba tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lazy-loading 'fault' on Instance uuid 3baa270c-fed4-45ed-b3c2-bec6c36b92b3 {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:06:53.172192 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-39ea0d5c-8b6d-4470-923e-960ce0f540ba tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bca70e61b80499eb07a668e11534257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df5fe3a39fd4f9fb1ae104e43ec5529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:53.181776 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-39ea0d5c-8b6d-4470-923e-960ce0f540ba tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 200 len: 1304 microversion: 2.1 time: 0.183792 Sep 14 01:06:53.182441 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 197/373] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:52 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 1304 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:53.212079 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-1034d7d7-5152-48dd-a195-692cf0f35fe5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:53.226004 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-1034d7d7-5152-48dd-a195-692cf0f35fe5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1510 microversion: 2.1 time: 0.368452 Sep 14 01:06:53.227941 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 177/374] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:52 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1510 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:53.897173 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-93802068-017e-4572-97ab-5f838cad8daa tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:53.898154 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-93802068-017e-4572-97ab-5f838cad8daa tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:53.905449 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-93802068-017e-4572-97ab-5f838cad8daa tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:53.906125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-93802068-017e-4572-97ab-5f838cad8daa tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:53.906686 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-93802068-017e-4572-97ab-5f838cad8daa tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:53.908229 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-93802068-017e-4572-97ab-5f838cad8daa tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:53.908733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-93802068-017e-4572-97ab-5f838cad8daa tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:53.909182 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-93802068-017e-4572-97ab-5f838cad8daa tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:54.126173 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-93802068-017e-4572-97ab-5f838cad8daa tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:54.135987 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-93802068-017e-4572-97ab-5f838cad8daa tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.245191 Sep 14 01:06:54.136562 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 198/375] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:53 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:54.212188 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7f34279d-5245-4fc7-8480-5c5efd922c97 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:54.212870 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7f34279d-5245-4fc7-8480-5c5efd922c97 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] [instance: 3baa270c-fed4-45ed-b3c2-bec6c36b92b3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:54.223520 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7f34279d-5245-4fc7-8480-5c5efd922c97 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:54.224186 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7f34279d-5245-4fc7-8480-5c5efd922c97 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:54.224828 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7f34279d-5245-4fc7-8480-5c5efd922c97 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:54.225750 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7f34279d-5245-4fc7-8480-5c5efd922c97 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:54.226400 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7f34279d-5245-4fc7-8480-5c5efd922c97 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:54.227042 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7f34279d-5245-4fc7-8480-5c5efd922c97 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:54.246183 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-7f34279d-5245-4fc7-8480-5c5efd922c97 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] HTTP exception thrown: Instance 3baa270c-fed4-45ed-b3c2-bec6c36b92b3 could not be found. Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7f34279d-5245-4fc7-8480-5c5efd922c97 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Request method failure captured: Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 HTTP/1.1 Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISjtpHSST4FOpvuMaAe36KQPI_KH5sVwJA9V87ybT9QIUm8ACi3YY7S4u-7tGf7jFyJy0M79k3jBF_FqgRPv58xKLzFlNIB9mIJYp_jK5jvAPx8cs-UE0nhrG0I61GtWygSTiysTf7gshDjyZgN7pnjh66VA8POl2R4w96IawnYstBk Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 6df5fe3a39fd4f9fb1ae104e43ec5529 Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-VolumesActionsTest-1201979577 Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:06:54.249842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:06:54.251165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6df5fe3a39fd4f9fb1ae104e43ec5529"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6df5fe3a39fd4f9fb1ae104e43ec5529"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6df5fe3a39fd4f9fb1ae104e43ec5529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6df5fe3a39fd4f9fb1ae104e43ec5529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:06:54.251165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-VolumesActionsTest-1201979577 Sep 14 01:06:54.251165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 6df5fe3a39fd4f9fb1ae104e43ec5529 Sep 14 01:06:54.251165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-VolumesActionsTest-1201979577 Sep 14 01:06:54.251165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-VolumesActionsTest-1201979577-project Sep 14 01:06:54.251165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:06:54.251165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:06:54.251165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: 9bca70e61b80499eb07a668e11534257 Sep 14 01:06:54.251165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-VolumesActionsTest-1201979577-project Sep 14 01:06:54.251165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:06:54.251165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance 3baa270c-fed4-45ed-b3c2-bec6c36b92b3 could not be found. Sep 14 01:06:54.251165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': '3baa270c-fed4-45ed-b3c2-bec6c36b92b3'} Sep 14 01:06:54.253223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:06:54.253223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:54.253223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:06:54.253223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:06:54.253223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:06:54.253223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:06:54.253223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:06:54.253223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:06:54.253223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:06:54.253223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:06:54.253223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3baa270c-fed4-45ed-b3c2-bec6c36b92b3 could not be found. Sep 14 01:06:54.253223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:06:54.253223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:06:54.253223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:06:54.253223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:54.253223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:06:54.253223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:06:54.253223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:06:54.253223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:06:54.253223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:06:54.254442 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:06:54.254442 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:06:54.254442 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:06:54.254442 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:06:54.254442 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:06:54.254442 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:06:54.254442 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:06:54.254442 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3baa270c-fed4-45ed-b3c2-bec6c36b92b3 could not be found. Sep 14 01:06:54.254442 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:06:54.254442 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:06:54.254442 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:06:54.254442 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:06:54.254442 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:06:54.254442 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:06:54.254442 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:06:54.254442 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:06:54.254442 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3baa270c-fed4-45ed-b3c2-bec6c36b92b3 could not be found. Sep 14 01:06:54.254442 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:06:54.257625 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7f34279d-5245-4fc7-8480-5c5efd922c97 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] Returning 404 to user: Instance 3baa270c-fed4-45ed-b3c2-bec6c36b92b3 could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:06:54.259044 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7f34279d-5245-4fc7-8480-5c5efd922c97 tempest-VolumesActionsTest-1201979577 tempest-VolumesActionsTest-1201979577-project] 10.222.0.42 "GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3" status: 404 len: 111 microversion: 2.1 time: 0.054406 Sep 14 01:06:54.262289 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f7031925-1a9a-42fd-bf39-ce7981210ede tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:54.263379 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f7031925-1a9a-42fd-bf39-ce7981210ede tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:54.264328 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 178/376] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:54 2022] GET /compute/v2.1/servers/3baa270c-fed4-45ed-b3c2-bec6c36b92b3 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:06:54.291754 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f7031925-1a9a-42fd-bf39-ce7981210ede tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:54.292486 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f7031925-1a9a-42fd-bf39-ce7981210ede tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:54.294027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f7031925-1a9a-42fd-bf39-ce7981210ede tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:54.294807 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f7031925-1a9a-42fd-bf39-ce7981210ede tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:54.300168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f7031925-1a9a-42fd-bf39-ce7981210ede tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:54.300675 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f7031925-1a9a-42fd-bf39-ce7981210ede tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:54.508777 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f7031925-1a9a-42fd-bf39-ce7981210ede tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:54.519243 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f7031925-1a9a-42fd-bf39-ce7981210ede tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1510 microversion: 2.1 time: 0.268576 Sep 14 01:06:54.520180 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 199/377] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:54 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1510 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:54.941304 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-395b3885-5008-4716-8bc7-0bdb057b8056 req-b1c71b09-cc8e-4e8c-b4a2-e51ac179794d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd1b7018-c9a6-4ee8-876b-8c701b568fac", "tag": "a24cbf5e-9696-4465-8ed2-8a2847a7e4ac"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:06:54.953618 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-395b3885-5008-4716-8bc7-0bdb057b8056 req-b1c71b09-cc8e-4e8c-b4a2-e51ac179794d service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:54.954111 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-395b3885-5008-4716-8bc7-0bdb057b8056 req-b1c71b09-cc8e-4e8c-b4a2-e51ac179794d service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:54.955203 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-395b3885-5008-4716-8bc7-0bdb057b8056 req-b1c71b09-cc8e-4e8c-b4a2-e51ac179794d service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:54.967452 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-395b3885-5008-4716-8bc7-0bdb057b8056 req-b1c71b09-cc8e-4e8c-b4a2-e51ac179794d service nova] Creating event network-changed:a24cbf5e-9696-4465-8ed2-8a2847a7e4ac for instance bd1b7018-c9a6-4ee8-876b-8c701b568fac on hv-cinder-85752 Sep 14 01:06:54.975840 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-395b3885-5008-4716-8bc7-0bdb057b8056 req-b1c71b09-cc8e-4e8c-b4a2-e51ac179794d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036108 Sep 14 01:06:54.977871 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 179/378] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:06:55.161095 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-57e6043d-a49f-4732-8301-2e1ff94ef87c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:55.162359 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-57e6043d-a49f-4732-8301-2e1ff94ef87c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:55.166323 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:55.167286 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=6 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:55.176048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-57e6043d-a49f-4732-8301-2e1ff94ef87c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:55.176555 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-57e6043d-a49f-4732-8301-2e1ff94ef87c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:55.176997 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-57e6043d-a49f-4732-8301-2e1ff94ef87c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:55.177708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-57e6043d-a49f-4732-8301-2e1ff94ef87c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:55.178167 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-57e6043d-a49f-4732-8301-2e1ff94ef87c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:55.178589 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-57e6043d-a49f-4732-8301-2e1ff94ef87c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:55.343023 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-57e6043d-a49f-4732-8301-2e1ff94ef87c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:55.347982 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:55.352752 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-57e6043d-a49f-4732-8301-2e1ff94ef87c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.196824 Sep 14 01:06:55.353335 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 200/379] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:55 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:06:55.540165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=2 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:06:55.545656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-f2e1c6d5-c70a-4786-b40f-1a328462634d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:55.546350 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-f2e1c6d5-c70a-4786-b40f-1a328462634d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:55.560734 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f2e1c6d5-c70a-4786-b40f-1a328462634d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:55.561265 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f2e1c6d5-c70a-4786-b40f-1a328462634d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:55.561710 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f2e1c6d5-c70a-4786-b40f-1a328462634d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:55.562413 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f2e1c6d5-c70a-4786-b40f-1a328462634d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:55.562867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f2e1c6d5-c70a-4786-b40f-1a328462634d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:55.563290 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f2e1c6d5-c70a-4786-b40f-1a328462634d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:55.710532 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-f2e1c6d5-c70a-4786-b40f-1a328462634d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:55.718826 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-f2e1c6d5-c70a-4786-b40f-1a328462634d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1510 microversion: 2.1 time: 0.179562 Sep 14 01:06:55.719405 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 180/380] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:55 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:56.375050 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-968e82dd-c973-4cad-bc02-6e6a79bdbfb0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:56.375752 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-968e82dd-c973-4cad-bc02-6e6a79bdbfb0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:56.382575 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-968e82dd-c973-4cad-bc02-6e6a79bdbfb0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:56.383054 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-968e82dd-c973-4cad-bc02-6e6a79bdbfb0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:56.383482 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-968e82dd-c973-4cad-bc02-6e6a79bdbfb0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:56.384272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-968e82dd-c973-4cad-bc02-6e6a79bdbfb0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:56.384725 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-968e82dd-c973-4cad-bc02-6e6a79bdbfb0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:56.385140 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-968e82dd-c973-4cad-bc02-6e6a79bdbfb0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:56.528295 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-968e82dd-c973-4cad-bc02-6e6a79bdbfb0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:56.536780 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-968e82dd-c973-4cad-bc02-6e6a79bdbfb0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.165831 Sep 14 01:06:56.537353 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 201/381] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:56 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:56.742997 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2a86b12e-7b22-4a2a-a08c-1883512220b8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:56.743625 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2a86b12e-7b22-4a2a-a08c-1883512220b8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:56.749954 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2a86b12e-7b22-4a2a-a08c-1883512220b8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:56.750439 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2a86b12e-7b22-4a2a-a08c-1883512220b8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:56.750876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2a86b12e-7b22-4a2a-a08c-1883512220b8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:56.751730 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2a86b12e-7b22-4a2a-a08c-1883512220b8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:56.752411 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2a86b12e-7b22-4a2a-a08c-1883512220b8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:56.752840 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2a86b12e-7b22-4a2a-a08c-1883512220b8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:56.890545 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-2a86b12e-7b22-4a2a-a08c-1883512220b8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:56.899189 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2a86b12e-7b22-4a2a-a08c-1883512220b8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1510 microversion: 2.1 time: 0.160227 Sep 14 01:06:56.899796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 181/382] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:56 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:57.561204 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1e9d22da-7ca7-494f-9a0a-f004c12dc683 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:57.561726 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1e9d22da-7ca7-494f-9a0a-f004c12dc683 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:57.569370 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1e9d22da-7ca7-494f-9a0a-f004c12dc683 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:57.569880 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1e9d22da-7ca7-494f-9a0a-f004c12dc683 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:57.570318 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1e9d22da-7ca7-494f-9a0a-f004c12dc683 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:57.571164 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1e9d22da-7ca7-494f-9a0a-f004c12dc683 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:57.571636 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1e9d22da-7ca7-494f-9a0a-f004c12dc683 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:57.572062 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1e9d22da-7ca7-494f-9a0a-f004c12dc683 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:57.702197 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1e9d22da-7ca7-494f-9a0a-f004c12dc683 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:57.711512 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1e9d22da-7ca7-494f-9a0a-f004c12dc683 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.154162 Sep 14 01:06:57.712200 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 202/383] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:57 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:57.923704 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-839fc976-c826-4c1d-b401-3156e9da5c7b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:57.924330 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-839fc976-c826-4c1d-b401-3156e9da5c7b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:57.931650 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-839fc976-c826-4c1d-b401-3156e9da5c7b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:57.932240 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-839fc976-c826-4c1d-b401-3156e9da5c7b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:57.932680 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-839fc976-c826-4c1d-b401-3156e9da5c7b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:57.933471 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-839fc976-c826-4c1d-b401-3156e9da5c7b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:57.934013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-839fc976-c826-4c1d-b401-3156e9da5c7b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:57.934467 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-839fc976-c826-4c1d-b401-3156e9da5c7b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:58.065682 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-839fc976-c826-4c1d-b401-3156e9da5c7b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:58.073304 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-839fc976-c826-4c1d-b401-3156e9da5c7b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1510 microversion: 2.1 time: 0.154087 Sep 14 01:06:58.073868 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 182/384] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:57 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:58.736708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4ac7e57b-a92d-4e0c-8945-4ddfc90052ae tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:58.737386 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4ac7e57b-a92d-4e0c-8945-4ddfc90052ae tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:58.744469 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4ac7e57b-a92d-4e0c-8945-4ddfc90052ae tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:58.744952 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4ac7e57b-a92d-4e0c-8945-4ddfc90052ae tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:58.745391 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4ac7e57b-a92d-4e0c-8945-4ddfc90052ae tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:58.746069 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4ac7e57b-a92d-4e0c-8945-4ddfc90052ae tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:58.746628 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4ac7e57b-a92d-4e0c-8945-4ddfc90052ae tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:58.747099 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4ac7e57b-a92d-4e0c-8945-4ddfc90052ae tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:58.877520 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4ac7e57b-a92d-4e0c-8945-4ddfc90052ae tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:58.885139 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4ac7e57b-a92d-4e0c-8945-4ddfc90052ae tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.153011 Sep 14 01:06:58.885688 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 203/385] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:58 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:59.097343 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-eab3e9e2-9295-40b0-b4e2-4e2ff9e4e97c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:59.097962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-eab3e9e2-9295-40b0-b4e2-4e2ff9e4e97c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:59.104425 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eab3e9e2-9295-40b0-b4e2-4e2ff9e4e97c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:59.104910 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eab3e9e2-9295-40b0-b4e2-4e2ff9e4e97c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:59.105350 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eab3e9e2-9295-40b0-b4e2-4e2ff9e4e97c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:59.106073 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eab3e9e2-9295-40b0-b4e2-4e2ff9e4e97c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:59.106531 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eab3e9e2-9295-40b0-b4e2-4e2ff9e4e97c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:59.106960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eab3e9e2-9295-40b0-b4e2-4e2ff9e4e97c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:59.237392 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-eab3e9e2-9295-40b0-b4e2-4e2ff9e4e97c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:06:59.245358 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-eab3e9e2-9295-40b0-b4e2-4e2ff9e4e97c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1510 microversion: 2.1 time: 0.152191 Sep 14 01:06:59.245937 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 183/386] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:59 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:06:59.908707 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-85dc719d-7c86-4fab-ae39-29a1a031dd32 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:06:59.909330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-85dc719d-7c86-4fab-ae39-29a1a031dd32 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:06:59.915775 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85dc719d-7c86-4fab-ae39-29a1a031dd32 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:59.916349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85dc719d-7c86-4fab-ae39-29a1a031dd32 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:59.916868 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85dc719d-7c86-4fab-ae39-29a1a031dd32 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:06:59.917630 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85dc719d-7c86-4fab-ae39-29a1a031dd32 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:06:59.918191 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85dc719d-7c86-4fab-ae39-29a1a031dd32 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:06:59.918705 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85dc719d-7c86-4fab-ae39-29a1a031dd32 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:00.057180 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-85dc719d-7c86-4fab-ae39-29a1a031dd32 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:00.065580 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-85dc719d-7c86-4fab-ae39-29a1a031dd32 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.161327 Sep 14 01:07:00.066151 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 204/387] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:06:59 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:00.268738 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-cbd3ddb0-7f6b-4adf-bf6a-85686319ff2f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:00.269351 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-cbd3ddb0-7f6b-4adf-bf6a-85686319ff2f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:00.275765 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cbd3ddb0-7f6b-4adf-bf6a-85686319ff2f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:00.276250 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cbd3ddb0-7f6b-4adf-bf6a-85686319ff2f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:00.276703 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cbd3ddb0-7f6b-4adf-bf6a-85686319ff2f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:00.277371 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cbd3ddb0-7f6b-4adf-bf6a-85686319ff2f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:00.277825 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cbd3ddb0-7f6b-4adf-bf6a-85686319ff2f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:00.278249 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cbd3ddb0-7f6b-4adf-bf6a-85686319ff2f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:00.417998 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-cbd3ddb0-7f6b-4adf-bf6a-85686319ff2f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:00.425971 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-cbd3ddb0-7f6b-4adf-bf6a-85686319ff2f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1510 microversion: 2.1 time: 0.161427 Sep 14 01:07:00.426541 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 184/388] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:00 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:01.088916 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9d525269-4f35-45e2-b125-6cb661e5d18b tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:01.090168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9d525269-4f35-45e2-b125-6cb661e5d18b tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:01.099869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d525269-4f35-45e2-b125-6cb661e5d18b tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:01.100679 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d525269-4f35-45e2-b125-6cb661e5d18b tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:01.101451 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d525269-4f35-45e2-b125-6cb661e5d18b tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:01.103357 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d525269-4f35-45e2-b125-6cb661e5d18b tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:01.104322 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d525269-4f35-45e2-b125-6cb661e5d18b tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:01.105169 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9d525269-4f35-45e2-b125-6cb661e5d18b tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:01.334310 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9d525269-4f35-45e2-b125-6cb661e5d18b tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:01.346452 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9d525269-4f35-45e2-b125-6cb661e5d18b tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.261642 Sep 14 01:07:01.347199 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 205/389] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:01 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:01.457053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-fc196d7e-743b-41cf-b515-41d01836bfb1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:01.465251 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-fc196d7e-743b-41cf-b515-41d01836bfb1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:01.484788 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fc196d7e-743b-41cf-b515-41d01836bfb1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:01.486911 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fc196d7e-743b-41cf-b515-41d01836bfb1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:01.487532 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fc196d7e-743b-41cf-b515-41d01836bfb1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:01.488306 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fc196d7e-743b-41cf-b515-41d01836bfb1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:01.489084 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fc196d7e-743b-41cf-b515-41d01836bfb1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:01.489719 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fc196d7e-743b-41cf-b515-41d01836bfb1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:01.519028 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:01.701242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-fc196d7e-743b-41cf-b515-41d01836bfb1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:01.713104 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-fc196d7e-743b-41cf-b515-41d01836bfb1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1510 microversion: 2.1 time: 0.263139 Sep 14 01:07:01.723598 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 185/390] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:01 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1510 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:02.378475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5b401b9a-6631-458e-af9a-75635c97c989 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:02.379987 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5b401b9a-6631-458e-af9a-75635c97c989 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:02.388053 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5b401b9a-6631-458e-af9a-75635c97c989 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:02.389165 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5b401b9a-6631-458e-af9a-75635c97c989 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:02.389784 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5b401b9a-6631-458e-af9a-75635c97c989 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:02.390669 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5b401b9a-6631-458e-af9a-75635c97c989 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:02.391381 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5b401b9a-6631-458e-af9a-75635c97c989 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:02.392532 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5b401b9a-6631-458e-af9a-75635c97c989 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:02.552843 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5b401b9a-6631-458e-af9a-75635c97c989 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:02.561548 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5b401b9a-6631-458e-af9a-75635c97c989 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.187486 Sep 14 01:07:02.562249 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 206/391] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:02 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:02.741172 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-b430fa25-9775-49f7-a5fc-8ab3ea9ce9c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:02.742015 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-b430fa25-9775-49f7-a5fc-8ab3ea9ce9c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:02.747698 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b430fa25-9775-49f7-a5fc-8ab3ea9ce9c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:02.748410 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b430fa25-9775-49f7-a5fc-8ab3ea9ce9c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:02.749239 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b430fa25-9775-49f7-a5fc-8ab3ea9ce9c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:02.750122 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b430fa25-9775-49f7-a5fc-8ab3ea9ce9c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:02.750752 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b430fa25-9775-49f7-a5fc-8ab3ea9ce9c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:02.751370 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b430fa25-9775-49f7-a5fc-8ab3ea9ce9c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:02.917542 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b430fa25-9775-49f7-a5fc-8ab3ea9ce9c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:02.927430 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-b430fa25-9775-49f7-a5fc-8ab3ea9ce9c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1516 microversion: 2.1 time: 0.192462 Sep 14 01:07:02.932031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 186/392] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:02 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1516 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:07:03.590172 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b8399a91-7b9f-4478-acae-8a3acd68ed82 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:03.590772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b8399a91-7b9f-4478-acae-8a3acd68ed82 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:03.596700 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8399a91-7b9f-4478-acae-8a3acd68ed82 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:03.597180 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8399a91-7b9f-4478-acae-8a3acd68ed82 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:03.597614 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8399a91-7b9f-4478-acae-8a3acd68ed82 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:03.598296 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8399a91-7b9f-4478-acae-8a3acd68ed82 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:03.598775 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8399a91-7b9f-4478-acae-8a3acd68ed82 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:03.599187 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b8399a91-7b9f-4478-acae-8a3acd68ed82 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:03.729431 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b8399a91-7b9f-4478-acae-8a3acd68ed82 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:03.738441 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b8399a91-7b9f-4478-acae-8a3acd68ed82 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.152235 Sep 14 01:07:03.739013 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 207/393] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:03 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:04.761800 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2c9216b2-aca6-4c3a-b76d-14088b9e543f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:04.762415 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2c9216b2-aca6-4c3a-b76d-14088b9e543f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:04.765008 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:04.770899 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2c9216b2-aca6-4c3a-b76d-14088b9e543f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:04.771383 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2c9216b2-aca6-4c3a-b76d-14088b9e543f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:04.771845 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2c9216b2-aca6-4c3a-b76d-14088b9e543f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:04.772531 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2c9216b2-aca6-4c3a-b76d-14088b9e543f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:04.772988 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2c9216b2-aca6-4c3a-b76d-14088b9e543f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:04.773411 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2c9216b2-aca6-4c3a-b76d-14088b9e543f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:04.903576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-2c9216b2-aca6-4c3a-b76d-14088b9e543f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:04.911195 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2c9216b2-aca6-4c3a-b76d-14088b9e543f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.153264 Sep 14 01:07:04.911819 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 187/394] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:04 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:05.934045 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5ee81afc-563c-47fd-91a1-a6607e1d7ff5 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:05.934677 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5ee81afc-563c-47fd-91a1-a6607e1d7ff5 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:05.940884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ee81afc-563c-47fd-91a1-a6607e1d7ff5 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:05.941358 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ee81afc-563c-47fd-91a1-a6607e1d7ff5 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:05.941784 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ee81afc-563c-47fd-91a1-a6607e1d7ff5 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:05.942533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ee81afc-563c-47fd-91a1-a6607e1d7ff5 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:05.942908 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ee81afc-563c-47fd-91a1-a6607e1d7ff5 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:05.943323 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ee81afc-563c-47fd-91a1-a6607e1d7ff5 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:06.071863 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5ee81afc-563c-47fd-91a1-a6607e1d7ff5 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:06.080002 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5ee81afc-563c-47fd-91a1-a6607e1d7ff5 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.149851 Sep 14 01:07:06.080571 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 208/395] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:05 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:07.103245 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-387b8e42-8f5a-48ef-b980-66680880883f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:07.104655 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-387b8e42-8f5a-48ef-b980-66680880883f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:07.111538 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-387b8e42-8f5a-48ef-b980-66680880883f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:07.112053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-387b8e42-8f5a-48ef-b980-66680880883f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:07.112489 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-387b8e42-8f5a-48ef-b980-66680880883f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:07.113187 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-387b8e42-8f5a-48ef-b980-66680880883f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:07.113642 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-387b8e42-8f5a-48ef-b980-66680880883f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:07.114067 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-387b8e42-8f5a-48ef-b980-66680880883f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:07.270702 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-387b8e42-8f5a-48ef-b980-66680880883f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:07.278986 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-387b8e42-8f5a-48ef-b980-66680880883f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.179541 Sep 14 01:07:07.292216 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 188/396] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:07 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:08.301806 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-afcb1765-4caf-4d49-9932-d2637fb85fe5 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:08.303134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-afcb1765-4caf-4d49-9932-d2637fb85fe5 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:08.313394 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-afcb1765-4caf-4d49-9932-d2637fb85fe5 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:08.314227 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-afcb1765-4caf-4d49-9932-d2637fb85fe5 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:08.315060 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-afcb1765-4caf-4d49-9932-d2637fb85fe5 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:08.316064 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-afcb1765-4caf-4d49-9932-d2637fb85fe5 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:08.316749 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-afcb1765-4caf-4d49-9932-d2637fb85fe5 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:08.317400 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-afcb1765-4caf-4d49-9932-d2637fb85fe5 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:08.493334 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-afcb1765-4caf-4d49-9932-d2637fb85fe5 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:08.511116 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-afcb1765-4caf-4d49-9932-d2637fb85fe5 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.213629 Sep 14 01:07:08.513717 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 209/397] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:08 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:07:08.624734 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-021dd8f5-edae-4f86-81ea-1f6edb8b9979 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Action: 'create', calling method: .version_select at 0x7f5043f37670>, body: {"keypair": {"name": "tempest-keypair-269254312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHyNML/tz3JmjK7zqEt1Ht+/nJv0XBG6ehQ82NlTtixQTBL/fBMcHpn4D6yS5Ke3XLWfjFIAEBJOtmWxvo+wkffpv/XnzLJMaPOMaldf848nbkwPGTsAgrfZ7LsgGnO3w=="}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:07:08.655909 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-021dd8f5-edae-4f86-81ea-1f6edb8b9979 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Getting quotas for project d1dd868f069a46dbb6bfd549f6bbf7b8. Resources: {'key_pairs'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:07:08.662019 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-021dd8f5-edae-4f86-81ea-1f6edb8b9979 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Getting quotas for user bf73eca572454b88843785d791f0b471 and project d1dd868f069a46dbb6bfd549f6bbf7b8. Resources: {'key_pairs'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:07:08.690499 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-021dd8f5-edae-4f86-81ea-1f6edb8b9979 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069526 Sep 14 01:07:08.691793 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 189/398] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Sep 14 01:07:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:07:09.537625 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f0ee6aa2-415b-42be-95a6-047a5c51abcb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:09.538228 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f0ee6aa2-415b-42be-95a6-047a5c51abcb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:09.543937 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:09.545724 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f0ee6aa2-415b-42be-95a6-047a5c51abcb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:09.546771 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f0ee6aa2-415b-42be-95a6-047a5c51abcb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:09.548196 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f0ee6aa2-415b-42be-95a6-047a5c51abcb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:09.549820 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f0ee6aa2-415b-42be-95a6-047a5c51abcb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:09.550696 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f0ee6aa2-415b-42be-95a6-047a5c51abcb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:09.551397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f0ee6aa2-415b-42be-95a6-047a5c51abcb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:09.733076 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f0ee6aa2-415b-42be-95a6-047a5c51abcb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:09.743183 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f0ee6aa2-415b-42be-95a6-047a5c51abcb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.209614 Sep 14 01:07:09.744463 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 210/399] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:09 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:07:10.265873 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-38aaeb39-7f3d-46c8-afd8-2779c752a310 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-608649899", "imageRef": "a2619027-0d8b-4ca3-9528-1ac3380cab5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2601f91b-34fe-45a9-9f56-15ca3eaf5c1d"}], "security_groups": [{"name": "tempest-securitygroup--262527127"}], "key_name": "tempest-keypair-269254312", "user_data": "}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:07:10.389556 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.network.neutron [None req-38aaeb39-7f3d-46c8-afd8-2779c752a310 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] validate_networks() for [('2601f91b-34fe-45a9-9f56-15ca3eaf5c1d', None, None, None, None, None)] {{(pid=120620) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:07:10.769875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-62b34b7a-6f8e-4027-a72b-b68eb14c9a31 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:10.770445 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-62b34b7a-6f8e-4027-a72b-b68eb14c9a31 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:10.776271 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-62b34b7a-6f8e-4027-a72b-b68eb14c9a31 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:10.777910 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-62b34b7a-6f8e-4027-a72b-b68eb14c9a31 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:10.778401 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-62b34b7a-6f8e-4027-a72b-b68eb14c9a31 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:10.779653 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-62b34b7a-6f8e-4027-a72b-b68eb14c9a31 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:10.780305 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-62b34b7a-6f8e-4027-a72b-b68eb14c9a31 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:10.781554 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-62b34b7a-6f8e-4027-a72b-b68eb14c9a31 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:10.867480 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-38aaeb39-7f3d-46c8-afd8-2779c752a310 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Flavor limits 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:07:10.868171 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-38aaeb39-7f3d-46c8-afd8-2779c752a310 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Image limits 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:07:10.868647 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-38aaeb39-7f3d-46c8-afd8-2779c752a310 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Flavor pref 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:07:10.869056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-38aaeb39-7f3d-46c8-afd8-2779c752a310 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Image pref 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:07:10.869648 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-38aaeb39-7f3d-46c8-afd8-2779c752a310 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:07:10.883937 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-38aaeb39-7f3d-46c8-afd8-2779c752a310 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:10.884803 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-38aaeb39-7f3d-46c8-afd8-2779c752a310 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:10.885479 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-38aaeb39-7f3d-46c8-afd8-2779c752a310 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:10.886428 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-38aaeb39-7f3d-46c8-afd8-2779c752a310 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:10.887115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-38aaeb39-7f3d-46c8-afd8-2779c752a310 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:10.887785 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-38aaeb39-7f3d-46c8-afd8-2779c752a310 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:10.912714 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-38aaeb39-7f3d-46c8-afd8-2779c752a310 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Getting quotas for project d1dd868f069a46dbb6bfd549f6bbf7b8. Resources: {'cores', 'instances', 'ram'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:07:10.920353 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-38aaeb39-7f3d-46c8-afd8-2779c752a310 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Getting quotas for user bf73eca572454b88843785d791f0b471 and project d1dd868f069a46dbb6bfd549f6bbf7b8. Resources: {'cores', 'instances', 'ram'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:07:10.937068 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-38aaeb39-7f3d-46c8-afd8-2779c752a310 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Going to run 1 instances... {{(pid=120620) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:07:10.940216 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-38aaeb39-7f3d-46c8-afd8-2779c752a310 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a2619027-0d8b-4ca3-9528-1ac3380cab5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120620) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:07:10.955491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-62b34b7a-6f8e-4027-a72b-b68eb14c9a31 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:10.964343 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-62b34b7a-6f8e-4027-a72b-b68eb14c9a31 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.200892 Sep 14 01:07:10.965704 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 211/400] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:10 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:07:11.012702 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-38aaeb39-7f3d-46c8-afd8-2779c752a310 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.751446 Sep 14 01:07:11.024970 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 190/401] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 01:07:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 01:07:11.029584 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c00c9aaa-1253-41df-ad76-51f37d45c4e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:11.030791 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c00c9aaa-1253-41df-ad76-51f37d45c4e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:11.135055 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c00c9aaa-1253-41df-ad76-51f37d45c4e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:11.154955 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c00c9aaa-1253-41df-ad76-51f37d45c4e4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1244 microversion: 2.1 time: 0.132126 Sep 14 01:07:11.159328 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 212/402] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:11 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1244 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:11.990406 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9ad659ea-c917-4c73-bbd2-32d905ab5aa4 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:11.991048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9ad659ea-c917-4c73-bbd2-32d905ab5aa4 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:11.997495 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9ad659ea-c917-4c73-bbd2-32d905ab5aa4 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:11.998279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9ad659ea-c917-4c73-bbd2-32d905ab5aa4 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:11.998795 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9ad659ea-c917-4c73-bbd2-32d905ab5aa4 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:11.999454 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9ad659ea-c917-4c73-bbd2-32d905ab5aa4 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:11.999958 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9ad659ea-c917-4c73-bbd2-32d905ab5aa4 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:12.000419 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9ad659ea-c917-4c73-bbd2-32d905ab5aa4 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:12.141101 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9ad659ea-c917-4c73-bbd2-32d905ab5aa4 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:12.150608 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9ad659ea-c917-4c73-bbd2-32d905ab5aa4 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.164703 Sep 14 01:07:12.151336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 191/403] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:11 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:12.181285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-81cca89d-f5af-438a-a488-cbb0035b6e4b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:12.182507 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-81cca89d-f5af-438a-a488-cbb0035b6e4b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:12.190690 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81cca89d-f5af-438a-a488-cbb0035b6e4b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:12.191464 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81cca89d-f5af-438a-a488-cbb0035b6e4b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:12.192038 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81cca89d-f5af-438a-a488-cbb0035b6e4b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:12.192733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81cca89d-f5af-438a-a488-cbb0035b6e4b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:12.193352 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81cca89d-f5af-438a-a488-cbb0035b6e4b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:12.193807 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81cca89d-f5af-438a-a488-cbb0035b6e4b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:12.267666 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-81cca89d-f5af-438a-a488-cbb0035b6e4b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:12.275801 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-81cca89d-f5af-438a-a488-cbb0035b6e4b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1248 microversion: 2.1 time: 0.098677 Sep 14 01:07:12.276371 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 213/404] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:12 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1248 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:13.174941 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d0da0824-83c6-49ad-81d6-2fdfa77ce5b2 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:13.175588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d0da0824-83c6-49ad-81d6-2fdfa77ce5b2 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:13.182705 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d0da0824-83c6-49ad-81d6-2fdfa77ce5b2 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:13.183205 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d0da0824-83c6-49ad-81d6-2fdfa77ce5b2 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:13.183739 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d0da0824-83c6-49ad-81d6-2fdfa77ce5b2 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:13.184449 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d0da0824-83c6-49ad-81d6-2fdfa77ce5b2 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:13.184904 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d0da0824-83c6-49ad-81d6-2fdfa77ce5b2 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:13.185326 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d0da0824-83c6-49ad-81d6-2fdfa77ce5b2 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:13.302435 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-630f8d83-aade-4691-8401-bc6e2dd62b0d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:13.303086 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-630f8d83-aade-4691-8401-bc6e2dd62b0d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:13.310472 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-630f8d83-aade-4691-8401-bc6e2dd62b0d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:13.311286 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-630f8d83-aade-4691-8401-bc6e2dd62b0d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:13.311955 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-630f8d83-aade-4691-8401-bc6e2dd62b0d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:13.312705 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-630f8d83-aade-4691-8401-bc6e2dd62b0d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:13.313209 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-630f8d83-aade-4691-8401-bc6e2dd62b0d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:13.313713 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-630f8d83-aade-4691-8401-bc6e2dd62b0d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:13.350446 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d0da0824-83c6-49ad-81d6-2fdfa77ce5b2 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:13.364614 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d0da0824-83c6-49ad-81d6-2fdfa77ce5b2 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.194394 Sep 14 01:07:13.378957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 192/405] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:13 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:13.384491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-630f8d83-aade-4691-8401-bc6e2dd62b0d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:13.393717 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-630f8d83-aade-4691-8401-bc6e2dd62b0d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1248 microversion: 2.1 time: 0.095360 Sep 14 01:07:13.394305 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 214/406] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:13 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1248 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:14.387867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-c5114181-2cb1-4b82-8f7d-17499b912239 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:14.388858 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-c5114181-2cb1-4b82-8f7d-17499b912239 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:14.397050 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c5114181-2cb1-4b82-8f7d-17499b912239 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:14.397924 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c5114181-2cb1-4b82-8f7d-17499b912239 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:14.398585 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c5114181-2cb1-4b82-8f7d-17499b912239 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:14.399573 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c5114181-2cb1-4b82-8f7d-17499b912239 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:14.400251 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c5114181-2cb1-4b82-8f7d-17499b912239 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:14.400889 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c5114181-2cb1-4b82-8f7d-17499b912239 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:14.417635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5c1e8d4e-9d54-4dd2-9898-fea52784650b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:14.419311 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5c1e8d4e-9d54-4dd2-9898-fea52784650b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:14.428105 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5c1e8d4e-9d54-4dd2-9898-fea52784650b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:14.429196 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5c1e8d4e-9d54-4dd2-9898-fea52784650b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:14.429933 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5c1e8d4e-9d54-4dd2-9898-fea52784650b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:14.431919 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5c1e8d4e-9d54-4dd2-9898-fea52784650b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:14.432675 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5c1e8d4e-9d54-4dd2-9898-fea52784650b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:14.433383 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5c1e8d4e-9d54-4dd2-9898-fea52784650b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:14.538326 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5c1e8d4e-9d54-4dd2-9898-fea52784650b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:14.550914 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5c1e8d4e-9d54-4dd2-9898-fea52784650b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1248 microversion: 2.1 time: 0.138174 Sep 14 01:07:14.552208 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 215/407] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:14 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1248 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:14.660267 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c5114181-2cb1-4b82-8f7d-17499b912239 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:14.669174 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-c5114181-2cb1-4b82-8f7d-17499b912239 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.285341 Sep 14 01:07:14.670156 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 193/408] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:14 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:15.589893 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-13784528-5a0e-4e2e-9706-2342f85c617c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:15.591505 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-13784528-5a0e-4e2e-9706-2342f85c617c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:15.605539 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-13784528-5a0e-4e2e-9706-2342f85c617c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:15.607063 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-13784528-5a0e-4e2e-9706-2342f85c617c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:15.608153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-13784528-5a0e-4e2e-9706-2342f85c617c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:15.609135 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-13784528-5a0e-4e2e-9706-2342f85c617c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:15.609857 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-13784528-5a0e-4e2e-9706-2342f85c617c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:15.610129 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-13784528-5a0e-4e2e-9706-2342f85c617c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:15.697562 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-f4d4a320-23b5-4cc8-8a66-6ceff99738cb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:15.698897 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-f4d4a320-23b5-4cc8-8a66-6ceff99738cb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:15.711337 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f4d4a320-23b5-4cc8-8a66-6ceff99738cb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:15.712134 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f4d4a320-23b5-4cc8-8a66-6ceff99738cb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:15.712457 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-13784528-5a0e-4e2e-9706-2342f85c617c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:15.712925 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f4d4a320-23b5-4cc8-8a66-6ceff99738cb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:15.713925 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f4d4a320-23b5-4cc8-8a66-6ceff99738cb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:15.714646 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f4d4a320-23b5-4cc8-8a66-6ceff99738cb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:15.715257 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f4d4a320-23b5-4cc8-8a66-6ceff99738cb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:15.740811 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-13784528-5a0e-4e2e-9706-2342f85c617c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1304 microversion: 2.1 time: 0.165353 Sep 14 01:07:15.743372 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 216/409] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:15 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1304 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:16.008181 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-f4d4a320-23b5-4cc8-8a66-6ceff99738cb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:16.018007 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-f4d4a320-23b5-4cc8-8a66-6ceff99738cb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.324966 Sep 14 01:07:16.019190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 194/410] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:15 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:16.593993 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-246bb8e7-5013-4cf2-8fbe-e685bc81c6d1 req-0eede6f9-634c-44f5-8dd7-9dc3d98cba38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd1b7018-c9a6-4ee8-876b-8c701b568fac", "name": "network-vif-plugged", "status": "completed", "tag": "a24cbf5e-9696-4465-8ed2-8a2847a7e4ac"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:07:16.620070 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-246bb8e7-5013-4cf2-8fbe-e685bc81c6d1 req-0eede6f9-634c-44f5-8dd7-9dc3d98cba38 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:16.620590 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-246bb8e7-5013-4cf2-8fbe-e685bc81c6d1 req-0eede6f9-634c-44f5-8dd7-9dc3d98cba38 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:16.623510 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-246bb8e7-5013-4cf2-8fbe-e685bc81c6d1 req-0eede6f9-634c-44f5-8dd7-9dc3d98cba38 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:16.646152 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-246bb8e7-5013-4cf2-8fbe-e685bc81c6d1 req-0eede6f9-634c-44f5-8dd7-9dc3d98cba38 service nova] Creating event network-vif-plugged:a24cbf5e-9696-4465-8ed2-8a2847a7e4ac for instance bd1b7018-c9a6-4ee8-876b-8c701b568fac on hv-cinder-85752 Sep 14 01:07:16.655969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-246bb8e7-5013-4cf2-8fbe-e685bc81c6d1 req-0eede6f9-634c-44f5-8dd7-9dc3d98cba38 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065897 Sep 14 01:07:16.658303 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 217/411] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:07:16.771000 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6e0f76aa-7f24-4f69-ab5a-d049e5a034c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:16.771655 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-6e0f76aa-7f24-4f69-ab5a-d049e5a034c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:16.785076 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e0f76aa-7f24-4f69-ab5a-d049e5a034c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:16.785382 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e0f76aa-7f24-4f69-ab5a-d049e5a034c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:16.786825 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e0f76aa-7f24-4f69-ab5a-d049e5a034c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:16.787686 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e0f76aa-7f24-4f69-ab5a-d049e5a034c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:16.788382 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e0f76aa-7f24-4f69-ab5a-d049e5a034c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:16.789077 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e0f76aa-7f24-4f69-ab5a-d049e5a034c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:16.878426 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6e0f76aa-7f24-4f69-ab5a-d049e5a034c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:16.889287 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-6e0f76aa-7f24-4f69-ab5a-d049e5a034c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1302 microversion: 2.1 time: 0.128195 Sep 14 01:07:16.895876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 195/412] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:16 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1302 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:17.042619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6967ee9d-f1ea-42b4-ae66-671ce736030e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:17.043852 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6967ee9d-f1ea-42b4-ae66-671ce736030e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:17.051241 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6967ee9d-f1ea-42b4-ae66-671ce736030e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:17.052123 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6967ee9d-f1ea-42b4-ae66-671ce736030e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:17.052801 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6967ee9d-f1ea-42b4-ae66-671ce736030e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:17.053560 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6967ee9d-f1ea-42b4-ae66-671ce736030e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:17.054338 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6967ee9d-f1ea-42b4-ae66-671ce736030e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:17.057003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6967ee9d-f1ea-42b4-ae66-671ce736030e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:17.246887 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6967ee9d-f1ea-42b4-ae66-671ce736030e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:17.259030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6967ee9d-f1ea-42b4-ae66-671ce736030e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.221296 Sep 14 01:07:17.259549 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 218/413] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:17 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:17.921556 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a795effc-c438-4553-9437-99fecab14a9c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:17.922489 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a795effc-c438-4553-9437-99fecab14a9c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:17.929300 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a795effc-c438-4553-9437-99fecab14a9c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:17.929975 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a795effc-c438-4553-9437-99fecab14a9c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:17.930451 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a795effc-c438-4553-9437-99fecab14a9c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:17.931190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a795effc-c438-4553-9437-99fecab14a9c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:17.931689 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a795effc-c438-4553-9437-99fecab14a9c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:17.932329 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a795effc-c438-4553-9437-99fecab14a9c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:18.096003 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a795effc-c438-4553-9437-99fecab14a9c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:18.106146 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a795effc-c438-4553-9437-99fecab14a9c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.189870 Sep 14 01:07:18.106874 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 196/414] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:17 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:07:18.284662 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-604a4be8-70a2-4047-92eb-7370833dde5f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:18.285342 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-604a4be8-70a2-4047-92eb-7370833dde5f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:18.291308 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-604a4be8-70a2-4047-92eb-7370833dde5f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:18.291996 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-604a4be8-70a2-4047-92eb-7370833dde5f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:18.292596 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-604a4be8-70a2-4047-92eb-7370833dde5f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:18.293905 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-604a4be8-70a2-4047-92eb-7370833dde5f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:18.294779 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-604a4be8-70a2-4047-92eb-7370833dde5f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:18.295884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-604a4be8-70a2-4047-92eb-7370833dde5f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:18.301697 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:18.457855 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-604a4be8-70a2-4047-92eb-7370833dde5f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:18.465796 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-604a4be8-70a2-4047-92eb-7370833dde5f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.186208 Sep 14 01:07:18.466699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 219/415] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:18 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:19.131503 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-aaede466-6ec6-4dd3-a1c0-b572472932ae tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:19.132167 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-aaede466-6ec6-4dd3-a1c0-b572472932ae tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:19.145912 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aaede466-6ec6-4dd3-a1c0-b572472932ae tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:19.146422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aaede466-6ec6-4dd3-a1c0-b572472932ae tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:19.146874 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aaede466-6ec6-4dd3-a1c0-b572472932ae tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:19.147718 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aaede466-6ec6-4dd3-a1c0-b572472932ae tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:19.148182 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aaede466-6ec6-4dd3-a1c0-b572472932ae tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:19.150447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aaede466-6ec6-4dd3-a1c0-b572472932ae tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:19.397229 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-aaede466-6ec6-4dd3-a1c0-b572472932ae tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:19.405772 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-aaede466-6ec6-4dd3-a1c0-b572472932ae tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.278260 Sep 14 01:07:19.410075 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 197/416] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:19 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:19.491746 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a6f2b2e6-45bd-4931-9d97-30986aa07f96 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:19.492996 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a6f2b2e6-45bd-4931-9d97-30986aa07f96 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:19.499530 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a6f2b2e6-45bd-4931-9d97-30986aa07f96 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:19.500282 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a6f2b2e6-45bd-4931-9d97-30986aa07f96 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:19.501243 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a6f2b2e6-45bd-4931-9d97-30986aa07f96 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:19.502132 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a6f2b2e6-45bd-4931-9d97-30986aa07f96 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:19.502595 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a6f2b2e6-45bd-4931-9d97-30986aa07f96 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:19.503028 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a6f2b2e6-45bd-4931-9d97-30986aa07f96 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:19.703833 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a6f2b2e6-45bd-4931-9d97-30986aa07f96 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:19.730060 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a6f2b2e6-45bd-4931-9d97-30986aa07f96 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.241909 Sep 14 01:07:19.730756 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 220/417] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:19 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:19.755722 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-42c32562-caff-4382-9af7-7d66318429c6 req-0640fe6f-9ac7-43d0-a460-2904a15b2c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "413d7106-fff0-4516-b70d-1d687312c9aa", "tag": "41e3c7ae-c1a9-4785-bdec-300c125b2082"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:07:19.764867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-42c32562-caff-4382-9af7-7d66318429c6 req-0640fe6f-9ac7-43d0-a460-2904a15b2c43 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:19.765465 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-42c32562-caff-4382-9af7-7d66318429c6 req-0640fe6f-9ac7-43d0-a460-2904a15b2c43 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:19.766115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-42c32562-caff-4382-9af7-7d66318429c6 req-0640fe6f-9ac7-43d0-a460-2904a15b2c43 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:19.777393 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-42c32562-caff-4382-9af7-7d66318429c6 req-0640fe6f-9ac7-43d0-a460-2904a15b2c43 service nova] Creating event network-changed:41e3c7ae-c1a9-4785-bdec-300c125b2082 for instance 413d7106-fff0-4516-b70d-1d687312c9aa on hv-cinder-85752 Sep 14 01:07:19.783409 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-42c32562-caff-4382-9af7-7d66318429c6 req-0640fe6f-9ac7-43d0-a460-2904a15b2c43 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033686 Sep 14 01:07:19.784237 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 198/418] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:07:20.439663 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-01ba1a52-eb61-48e2-843e-81710f312866 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:20.440301 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-01ba1a52-eb61-48e2-843e-81710f312866 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:20.446840 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-01ba1a52-eb61-48e2-843e-81710f312866 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:20.447332 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-01ba1a52-eb61-48e2-843e-81710f312866 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:20.447798 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-01ba1a52-eb61-48e2-843e-81710f312866 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:20.448509 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-01ba1a52-eb61-48e2-843e-81710f312866 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:20.448953 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-01ba1a52-eb61-48e2-843e-81710f312866 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:20.449379 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-01ba1a52-eb61-48e2-843e-81710f312866 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:20.586809 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-01ba1a52-eb61-48e2-843e-81710f312866 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:20.594910 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-01ba1a52-eb61-48e2-843e-81710f312866 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.160426 Sep 14 01:07:20.595464 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 221/419] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:20 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:20.755522 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2f3394d3-b1eb-4eac-bfba-939816e5ee4d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:20.756175 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2f3394d3-b1eb-4eac-bfba-939816e5ee4d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:20.762554 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2f3394d3-b1eb-4eac-bfba-939816e5ee4d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:20.763615 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2f3394d3-b1eb-4eac-bfba-939816e5ee4d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:20.763763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2f3394d3-b1eb-4eac-bfba-939816e5ee4d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:20.764555 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2f3394d3-b1eb-4eac-bfba-939816e5ee4d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:20.765020 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2f3394d3-b1eb-4eac-bfba-939816e5ee4d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:20.765450 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2f3394d3-b1eb-4eac-bfba-939816e5ee4d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:20.899065 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=2 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:20.909989 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-2f3394d3-b1eb-4eac-bfba-939816e5ee4d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:20.917642 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2f3394d3-b1eb-4eac-bfba-939816e5ee4d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.166942 Sep 14 01:07:20.918276 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 199/420] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:20 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:21.618124 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-daad52db-6c24-4bc3-894e-b6068e103d70 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:21.618739 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-daad52db-6c24-4bc3-894e-b6068e103d70 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:21.620629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:21.626366 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-daad52db-6c24-4bc3-894e-b6068e103d70 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:21.626849 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-daad52db-6c24-4bc3-894e-b6068e103d70 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:21.627285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-daad52db-6c24-4bc3-894e-b6068e103d70 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:21.627999 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-daad52db-6c24-4bc3-894e-b6068e103d70 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:21.628454 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-daad52db-6c24-4bc3-894e-b6068e103d70 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:21.628882 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-daad52db-6c24-4bc3-894e-b6068e103d70 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:21.760497 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-daad52db-6c24-4bc3-894e-b6068e103d70 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:21.768333 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-daad52db-6c24-4bc3-894e-b6068e103d70 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.154183 Sep 14 01:07:21.768901 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 222/421] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:21 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:07:21.943785 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a28ec57d-41c3-4841-bb6f-5cbe16db37f0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:21.944482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a28ec57d-41c3-4841-bb6f-5cbe16db37f0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:21.946197 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=10 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:21.951750 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a28ec57d-41c3-4841-bb6f-5cbe16db37f0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:21.952227 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a28ec57d-41c3-4841-bb6f-5cbe16db37f0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:21.952657 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a28ec57d-41c3-4841-bb6f-5cbe16db37f0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:21.953542 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a28ec57d-41c3-4841-bb6f-5cbe16db37f0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:21.954002 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a28ec57d-41c3-4841-bb6f-5cbe16db37f0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:21.954506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a28ec57d-41c3-4841-bb6f-5cbe16db37f0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:22.085406 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a28ec57d-41c3-4841-bb6f-5cbe16db37f0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:22.093476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a28ec57d-41c3-4841-bb6f-5cbe16db37f0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.153557 Sep 14 01:07:22.094773 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 200/422] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:21 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:22.791275 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-26ffea08-e13a-4ce5-a2f8-529b39b2f382 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:22.791841 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-26ffea08-e13a-4ce5-a2f8-529b39b2f382 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:22.798349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-26ffea08-e13a-4ce5-a2f8-529b39b2f382 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:22.798823 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-26ffea08-e13a-4ce5-a2f8-529b39b2f382 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:22.799249 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-26ffea08-e13a-4ce5-a2f8-529b39b2f382 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:22.799956 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-26ffea08-e13a-4ce5-a2f8-529b39b2f382 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:22.800414 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-26ffea08-e13a-4ce5-a2f8-529b39b2f382 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:22.800865 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-26ffea08-e13a-4ce5-a2f8-529b39b2f382 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:22.936993 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-26ffea08-e13a-4ce5-a2f8-529b39b2f382 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:22.946227 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-26ffea08-e13a-4ce5-a2f8-529b39b2f382 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.159025 Sep 14 01:07:22.947093 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 223/423] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:22 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:23.117721 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4705a6c3-cd7c-4404-bf6e-023c5db147c7 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:23.118448 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4705a6c3-cd7c-4404-bf6e-023c5db147c7 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:23.124553 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4705a6c3-cd7c-4404-bf6e-023c5db147c7 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:23.125826 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4705a6c3-cd7c-4404-bf6e-023c5db147c7 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:23.126441 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4705a6c3-cd7c-4404-bf6e-023c5db147c7 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:23.127137 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4705a6c3-cd7c-4404-bf6e-023c5db147c7 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:23.127627 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4705a6c3-cd7c-4404-bf6e-023c5db147c7 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:23.128053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4705a6c3-cd7c-4404-bf6e-023c5db147c7 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:23.375787 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4705a6c3-cd7c-4404-bf6e-023c5db147c7 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:23.384370 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4705a6c3-cd7c-4404-bf6e-023c5db147c7 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1318 microversion: 2.1 time: 0.270397 Sep 14 01:07:23.385174 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 201/424] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:23 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:23.970871 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-73eb9bdb-b5ab-48b7-8baa-b451fe5ffff4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:23.971482 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-73eb9bdb-b5ab-48b7-8baa-b451fe5ffff4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:23.977794 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-73eb9bdb-b5ab-48b7-8baa-b451fe5ffff4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:23.978368 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-73eb9bdb-b5ab-48b7-8baa-b451fe5ffff4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:23.978832 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-73eb9bdb-b5ab-48b7-8baa-b451fe5ffff4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:23.979529 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-73eb9bdb-b5ab-48b7-8baa-b451fe5ffff4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:23.980064 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-73eb9bdb-b5ab-48b7-8baa-b451fe5ffff4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:23.980562 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-73eb9bdb-b5ab-48b7-8baa-b451fe5ffff4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:24.116950 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-73eb9bdb-b5ab-48b7-8baa-b451fe5ffff4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:24.125708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-73eb9bdb-b5ab-48b7-8baa-b451fe5ffff4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.158785 Sep 14 01:07:24.126698 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 224/425] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:23 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:24.409406 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9749ead5-9623-490e-a0a5-72eff1bd1fb1 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:24.410004 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9749ead5-9623-490e-a0a5-72eff1bd1fb1 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:24.416764 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9749ead5-9623-490e-a0a5-72eff1bd1fb1 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:24.417280 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9749ead5-9623-490e-a0a5-72eff1bd1fb1 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:24.417711 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9749ead5-9623-490e-a0a5-72eff1bd1fb1 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:24.418402 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9749ead5-9623-490e-a0a5-72eff1bd1fb1 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:24.418852 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9749ead5-9623-490e-a0a5-72eff1bd1fb1 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:24.419296 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9749ead5-9623-490e-a0a5-72eff1bd1fb1 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:24.638683 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9749ead5-9623-490e-a0a5-72eff1bd1fb1 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:24.646544 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9749ead5-9623-490e-a0a5-72eff1bd1fb1 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1505 microversion: 2.1 time: 0.241367 Sep 14 01:07:24.647116 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 202/426] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:24 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1505 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:25.149061 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-df8df0e9-6cdf-40f2-b6ea-fd1fa7590a79 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:25.149672 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-df8df0e9-6cdf-40f2-b6ea-fd1fa7590a79 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:25.158057 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df8df0e9-6cdf-40f2-b6ea-fd1fa7590a79 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:25.158985 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df8df0e9-6cdf-40f2-b6ea-fd1fa7590a79 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:25.159692 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df8df0e9-6cdf-40f2-b6ea-fd1fa7590a79 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:25.160935 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df8df0e9-6cdf-40f2-b6ea-fd1fa7590a79 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:25.161710 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df8df0e9-6cdf-40f2-b6ea-fd1fa7590a79 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:25.162275 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df8df0e9-6cdf-40f2-b6ea-fd1fa7590a79 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:25.318994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-df8df0e9-6cdf-40f2-b6ea-fd1fa7590a79 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:25.327119 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-df8df0e9-6cdf-40f2-b6ea-fd1fa7590a79 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.181862 Sep 14 01:07:25.327703 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 225/427] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:25 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:26.350683 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-61cc7e78-92bf-46dc-9c82-c0685f73da54 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:26.351246 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-61cc7e78-92bf-46dc-9c82-c0685f73da54 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:26.358176 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-61cc7e78-92bf-46dc-9c82-c0685f73da54 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:26.358796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-61cc7e78-92bf-46dc-9c82-c0685f73da54 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:26.359086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-61cc7e78-92bf-46dc-9c82-c0685f73da54 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:26.360694 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-61cc7e78-92bf-46dc-9c82-c0685f73da54 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:26.361231 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-61cc7e78-92bf-46dc-9c82-c0685f73da54 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:26.361798 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-61cc7e78-92bf-46dc-9c82-c0685f73da54 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:26.496891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-61cc7e78-92bf-46dc-9c82-c0685f73da54 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:26.505693 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-61cc7e78-92bf-46dc-9c82-c0685f73da54 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.158786 Sep 14 01:07:26.506258 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 203/428] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:26 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:27.533150 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ef2bbc33-cd3d-4a56-a4be-b44008ea3901 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:27.533759 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ef2bbc33-cd3d-4a56-a4be-b44008ea3901 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:27.539790 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ef2bbc33-cd3d-4a56-a4be-b44008ea3901 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:27.540294 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ef2bbc33-cd3d-4a56-a4be-b44008ea3901 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:27.540728 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ef2bbc33-cd3d-4a56-a4be-b44008ea3901 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:27.541413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ef2bbc33-cd3d-4a56-a4be-b44008ea3901 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:27.541863 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ef2bbc33-cd3d-4a56-a4be-b44008ea3901 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:27.542282 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ef2bbc33-cd3d-4a56-a4be-b44008ea3901 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:27.670844 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ef2bbc33-cd3d-4a56-a4be-b44008ea3901 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:27.678970 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ef2bbc33-cd3d-4a56-a4be-b44008ea3901 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.150328 Sep 14 01:07:27.679549 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 226/429] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:27 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:28.701966 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-3745a9d0-4fef-4d9d-9783-27c5172862ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:28.702573 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-3745a9d0-4fef-4d9d-9783-27c5172862ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:28.709812 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3745a9d0-4fef-4d9d-9783-27c5172862ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:28.710292 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3745a9d0-4fef-4d9d-9783-27c5172862ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:28.710762 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3745a9d0-4fef-4d9d-9783-27c5172862ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:28.711446 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3745a9d0-4fef-4d9d-9783-27c5172862ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:28.711922 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3745a9d0-4fef-4d9d-9783-27c5172862ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:28.712348 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3745a9d0-4fef-4d9d-9783-27c5172862ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:28.716298 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=100 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:28.840809 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-3745a9d0-4fef-4d9d-9783-27c5172862ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:28.848447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-3745a9d0-4fef-4d9d-9783-27c5172862ed tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.150361 Sep 14 01:07:28.849008 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 204/430] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:28 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:29.870094 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f1e22a0f-2d11-45a3-95ac-559e9e16ea18 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:29.870694 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f1e22a0f-2d11-45a3-95ac-559e9e16ea18 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:29.877440 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f1e22a0f-2d11-45a3-95ac-559e9e16ea18 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:29.877917 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f1e22a0f-2d11-45a3-95ac-559e9e16ea18 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:29.878369 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f1e22a0f-2d11-45a3-95ac-559e9e16ea18 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:29.879077 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f1e22a0f-2d11-45a3-95ac-559e9e16ea18 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:29.879539 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f1e22a0f-2d11-45a3-95ac-559e9e16ea18 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:29.880009 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f1e22a0f-2d11-45a3-95ac-559e9e16ea18 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:30.021263 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f1e22a0f-2d11-45a3-95ac-559e9e16ea18 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:30.029225 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f1e22a0f-2d11-45a3-95ac-559e9e16ea18 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.162918 Sep 14 01:07:30.029778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 227/431] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:29 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:31.053561 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-b9b2c8b4-edf4-4d3e-862b-a0da4a16fec1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:31.054173 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-b9b2c8b4-edf4-4d3e-862b-a0da4a16fec1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:31.060934 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b9b2c8b4-edf4-4d3e-862b-a0da4a16fec1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:31.061419 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b9b2c8b4-edf4-4d3e-862b-a0da4a16fec1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:31.061856 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b9b2c8b4-edf4-4d3e-862b-a0da4a16fec1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:31.062665 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b9b2c8b4-edf4-4d3e-862b-a0da4a16fec1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:31.063326 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b9b2c8b4-edf4-4d3e-862b-a0da4a16fec1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:31.063788 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b9b2c8b4-edf4-4d3e-862b-a0da4a16fec1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:31.200503 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b9b2c8b4-edf4-4d3e-862b-a0da4a16fec1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:31.208860 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-b9b2c8b4-edf4-4d3e-862b-a0da4a16fec1 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.159155 Sep 14 01:07:31.209449 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 205/432] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:31 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:32.233154 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-41b9e9db-067f-4e40-88ca-8728176b86be tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:32.233760 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-41b9e9db-067f-4e40-88ca-8728176b86be tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:32.240243 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-41b9e9db-067f-4e40-88ca-8728176b86be tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:32.240903 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-41b9e9db-067f-4e40-88ca-8728176b86be tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:32.241626 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-41b9e9db-067f-4e40-88ca-8728176b86be tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:32.242490 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-41b9e9db-067f-4e40-88ca-8728176b86be tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:32.243261 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-41b9e9db-067f-4e40-88ca-8728176b86be tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:32.243897 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-41b9e9db-067f-4e40-88ca-8728176b86be tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:32.389436 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-41b9e9db-067f-4e40-88ca-8728176b86be tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:32.398100 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-41b9e9db-067f-4e40-88ca-8728176b86be tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.168805 Sep 14 01:07:32.398651 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 228/433] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:32 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:33.423070 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ca558bdb-9425-4d60-b299-9e3ba2f4103d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:33.423837 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ca558bdb-9425-4d60-b299-9e3ba2f4103d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:33.435596 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ca558bdb-9425-4d60-b299-9e3ba2f4103d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:33.435596 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ca558bdb-9425-4d60-b299-9e3ba2f4103d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:33.435596 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ca558bdb-9425-4d60-b299-9e3ba2f4103d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:33.435596 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ca558bdb-9425-4d60-b299-9e3ba2f4103d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:33.436081 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ca558bdb-9425-4d60-b299-9e3ba2f4103d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:33.436429 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ca558bdb-9425-4d60-b299-9e3ba2f4103d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:33.607394 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ca558bdb-9425-4d60-b299-9e3ba2f4103d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:33.617900 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ca558bdb-9425-4d60-b299-9e3ba2f4103d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.200561 Sep 14 01:07:33.618480 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 206/434] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:33 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:07:34.646120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5ed8e764-bfbe-42c0-aba8-db115824cc4a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:34.646749 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5ed8e764-bfbe-42c0-aba8-db115824cc4a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:34.652626 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ed8e764-bfbe-42c0-aba8-db115824cc4a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:34.653098 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ed8e764-bfbe-42c0-aba8-db115824cc4a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:34.653525 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ed8e764-bfbe-42c0-aba8-db115824cc4a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:34.654225 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ed8e764-bfbe-42c0-aba8-db115824cc4a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:34.654675 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ed8e764-bfbe-42c0-aba8-db115824cc4a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:34.655090 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ed8e764-bfbe-42c0-aba8-db115824cc4a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:34.788461 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5ed8e764-bfbe-42c0-aba8-db115824cc4a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:34.795927 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5ed8e764-bfbe-42c0-aba8-db115824cc4a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.153716 Sep 14 01:07:34.796552 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 229/435] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:34 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:35.819687 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-194203ba-65b7-44db-a4e8-ff86c7714bb3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:35.820302 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-194203ba-65b7-44db-a4e8-ff86c7714bb3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:35.822674 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:35.827961 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-194203ba-65b7-44db-a4e8-ff86c7714bb3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:35.828443 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-194203ba-65b7-44db-a4e8-ff86c7714bb3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:35.828875 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-194203ba-65b7-44db-a4e8-ff86c7714bb3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:35.829576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-194203ba-65b7-44db-a4e8-ff86c7714bb3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:35.830028 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-194203ba-65b7-44db-a4e8-ff86c7714bb3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:35.830450 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-194203ba-65b7-44db-a4e8-ff86c7714bb3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:35.967308 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-194203ba-65b7-44db-a4e8-ff86c7714bb3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:35.975483 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-194203ba-65b7-44db-a4e8-ff86c7714bb3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.159923 Sep 14 01:07:35.976081 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 207/436] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:35 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:37.000351 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f56deef9-a822-4ea3-a9bc-8ec30e152880 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:37.001034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f56deef9-a822-4ea3-a9bc-8ec30e152880 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:37.006911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f56deef9-a822-4ea3-a9bc-8ec30e152880 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:37.007400 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f56deef9-a822-4ea3-a9bc-8ec30e152880 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:37.007865 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f56deef9-a822-4ea3-a9bc-8ec30e152880 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:37.008560 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f56deef9-a822-4ea3-a9bc-8ec30e152880 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:37.009019 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f56deef9-a822-4ea3-a9bc-8ec30e152880 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:37.009449 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f56deef9-a822-4ea3-a9bc-8ec30e152880 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:37.139063 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f56deef9-a822-4ea3-a9bc-8ec30e152880 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:37.147534 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f56deef9-a822-4ea3-a9bc-8ec30e152880 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.151649 Sep 14 01:07:37.148124 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 230/437] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:36 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:38.170142 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6367fddc-a5cd-4b32-bf80-9ef2c487f171 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:38.170751 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-6367fddc-a5cd-4b32-bf80-9ef2c487f171 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:38.177865 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6367fddc-a5cd-4b32-bf80-9ef2c487f171 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:38.178348 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6367fddc-a5cd-4b32-bf80-9ef2c487f171 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:38.178782 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6367fddc-a5cd-4b32-bf80-9ef2c487f171 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:38.179466 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6367fddc-a5cd-4b32-bf80-9ef2c487f171 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:38.179949 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6367fddc-a5cd-4b32-bf80-9ef2c487f171 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:38.180368 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6367fddc-a5cd-4b32-bf80-9ef2c487f171 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:38.316174 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6367fddc-a5cd-4b32-bf80-9ef2c487f171 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:38.324411 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-6367fddc-a5cd-4b32-bf80-9ef2c487f171 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.158041 Sep 14 01:07:38.324986 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 208/438] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:38 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:39.349561 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-45930d8f-1176-414f-8034-5e42de1235c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:39.350800 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-45930d8f-1176-414f-8034-5e42de1235c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:39.356999 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-45930d8f-1176-414f-8034-5e42de1235c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:39.357651 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-45930d8f-1176-414f-8034-5e42de1235c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:39.358430 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-45930d8f-1176-414f-8034-5e42de1235c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:39.359278 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-45930d8f-1176-414f-8034-5e42de1235c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:39.359846 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-45930d8f-1176-414f-8034-5e42de1235c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:39.360278 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-45930d8f-1176-414f-8034-5e42de1235c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:39.503405 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-45930d8f-1176-414f-8034-5e42de1235c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:39.511170 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-45930d8f-1176-414f-8034-5e42de1235c8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.167545 Sep 14 01:07:39.511767 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 231/439] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:39 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:40.535268 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-77b11ed1-826a-406f-889e-b9fce50dad5a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:40.535933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-77b11ed1-826a-406f-889e-b9fce50dad5a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:40.542849 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-77b11ed1-826a-406f-889e-b9fce50dad5a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:40.543425 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-77b11ed1-826a-406f-889e-b9fce50dad5a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:40.543997 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-77b11ed1-826a-406f-889e-b9fce50dad5a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:40.544739 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-77b11ed1-826a-406f-889e-b9fce50dad5a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:40.545225 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-77b11ed1-826a-406f-889e-b9fce50dad5a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:40.545616 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-77b11ed1-826a-406f-889e-b9fce50dad5a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:40.682554 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-77b11ed1-826a-406f-889e-b9fce50dad5a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:40.692610 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-77b11ed1-826a-406f-889e-b9fce50dad5a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.162055 Sep 14 01:07:40.693373 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 209/440] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:40 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:41.716299 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4bcd7a23-6e36-4bff-ab9b-496ce0ba5424 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:41.716898 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4bcd7a23-6e36-4bff-ab9b-496ce0ba5424 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:41.719876 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=46 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:41.725619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4bcd7a23-6e36-4bff-ab9b-496ce0ba5424 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:41.726094 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4bcd7a23-6e36-4bff-ab9b-496ce0ba5424 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:41.726521 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4bcd7a23-6e36-4bff-ab9b-496ce0ba5424 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:41.727202 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4bcd7a23-6e36-4bff-ab9b-496ce0ba5424 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:41.727689 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4bcd7a23-6e36-4bff-ab9b-496ce0ba5424 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:41.728113 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4bcd7a23-6e36-4bff-ab9b-496ce0ba5424 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:41.858720 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4bcd7a23-6e36-4bff-ab9b-496ce0ba5424 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:41.866569 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4bcd7a23-6e36-4bff-ab9b-496ce0ba5424 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.154122 Sep 14 01:07:41.867189 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 232/441] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:41 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:42.891130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-098662d6-cf66-4007-9cd1-56a81cb0963e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:42.891694 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-098662d6-cf66-4007-9cd1-56a81cb0963e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:42.898074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-098662d6-cf66-4007-9cd1-56a81cb0963e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:42.898691 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-098662d6-cf66-4007-9cd1-56a81cb0963e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:42.898983 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-098662d6-cf66-4007-9cd1-56a81cb0963e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:42.899693 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-098662d6-cf66-4007-9cd1-56a81cb0963e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:42.900140 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-098662d6-cf66-4007-9cd1-56a81cb0963e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:42.900560 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-098662d6-cf66-4007-9cd1-56a81cb0963e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:43.035917 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-098662d6-cf66-4007-9cd1-56a81cb0963e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:43.043500 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-098662d6-cf66-4007-9cd1-56a81cb0963e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.156851 Sep 14 01:07:43.044093 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 210/442] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:42 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:44.068569 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-99f9017c-bfaa-4daa-ab6f-b83147b4241e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:44.069351 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-99f9017c-bfaa-4daa-ab6f-b83147b4241e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:44.075316 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99f9017c-bfaa-4daa-ab6f-b83147b4241e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:44.075861 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99f9017c-bfaa-4daa-ab6f-b83147b4241e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:44.076297 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99f9017c-bfaa-4daa-ab6f-b83147b4241e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:44.076989 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99f9017c-bfaa-4daa-ab6f-b83147b4241e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:44.077445 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99f9017c-bfaa-4daa-ab6f-b83147b4241e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:44.077868 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99f9017c-bfaa-4daa-ab6f-b83147b4241e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:44.449073 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-99f9017c-bfaa-4daa-ab6f-b83147b4241e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:44.457960 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-99f9017c-bfaa-4daa-ab6f-b83147b4241e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.394443 Sep 14 01:07:44.458533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 233/443] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:44 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:45.480712 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d387847b-7da6-47c7-91e8-dd2e4cf4a3bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:45.481316 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d387847b-7da6-47c7-91e8-dd2e4cf4a3bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:45.488665 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d387847b-7da6-47c7-91e8-dd2e4cf4a3bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:45.489147 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d387847b-7da6-47c7-91e8-dd2e4cf4a3bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:45.489579 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d387847b-7da6-47c7-91e8-dd2e4cf4a3bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:45.490261 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d387847b-7da6-47c7-91e8-dd2e4cf4a3bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:45.490710 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d387847b-7da6-47c7-91e8-dd2e4cf4a3bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:45.491130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d387847b-7da6-47c7-91e8-dd2e4cf4a3bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:45.624633 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d387847b-7da6-47c7-91e8-dd2e4cf4a3bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:45.633027 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d387847b-7da6-47c7-91e8-dd2e4cf4a3bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.156124 Sep 14 01:07:45.633591 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 211/444] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:45 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:46.656563 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-07338230-e182-4530-8c69-dbf5ba539999 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:46.657155 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-07338230-e182-4530-8c69-dbf5ba539999 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:46.663411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-07338230-e182-4530-8c69-dbf5ba539999 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:46.663926 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-07338230-e182-4530-8c69-dbf5ba539999 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:46.664362 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-07338230-e182-4530-8c69-dbf5ba539999 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:46.665057 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-07338230-e182-4530-8c69-dbf5ba539999 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:46.665512 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-07338230-e182-4530-8c69-dbf5ba539999 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:46.665935 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-07338230-e182-4530-8c69-dbf5ba539999 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:46.796074 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-07338230-e182-4530-8c69-dbf5ba539999 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:46.804004 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-07338230-e182-4530-8c69-dbf5ba539999 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.151365 Sep 14 01:07:46.804581 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 234/445] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:46 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:47.827895 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-54ed42bf-d969-4c4e-9e26-3e0813884f37 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:47.828579 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-54ed42bf-d969-4c4e-9e26-3e0813884f37 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:47.835768 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-54ed42bf-d969-4c4e-9e26-3e0813884f37 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:47.836261 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-54ed42bf-d969-4c4e-9e26-3e0813884f37 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:47.836698 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-54ed42bf-d969-4c4e-9e26-3e0813884f37 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:47.837401 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-54ed42bf-d969-4c4e-9e26-3e0813884f37 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:47.837855 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-54ed42bf-d969-4c4e-9e26-3e0813884f37 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:47.838280 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-54ed42bf-d969-4c4e-9e26-3e0813884f37 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:47.974800 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-54ed42bf-d969-4c4e-9e26-3e0813884f37 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:47.984805 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-54ed42bf-d969-4c4e-9e26-3e0813884f37 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.161441 Sep 14 01:07:47.985830 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 212/446] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:47 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:49.009377 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7512f691-b72d-4855-ba64-f11a27bf6344 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:49.010008 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7512f691-b72d-4855-ba64-f11a27bf6344 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:49.016119 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7512f691-b72d-4855-ba64-f11a27bf6344 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:49.016600 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7512f691-b72d-4855-ba64-f11a27bf6344 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:49.017031 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7512f691-b72d-4855-ba64-f11a27bf6344 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:49.017714 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7512f691-b72d-4855-ba64-f11a27bf6344 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:49.018970 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7512f691-b72d-4855-ba64-f11a27bf6344 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:49.019482 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7512f691-b72d-4855-ba64-f11a27bf6344 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:49.022033 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=95 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:07:49.148057 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7512f691-b72d-4855-ba64-f11a27bf6344 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:49.155607 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7512f691-b72d-4855-ba64-f11a27bf6344 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.150020 Sep 14 01:07:49.156165 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 235/447] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:49 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:50.178790 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ec231296-bb4c-4044-bb0a-49c5c2fb10ff tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:50.179408 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ec231296-bb4c-4044-bb0a-49c5c2fb10ff tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:50.185858 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec231296-bb4c-4044-bb0a-49c5c2fb10ff tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:50.186347 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec231296-bb4c-4044-bb0a-49c5c2fb10ff tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:50.186788 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec231296-bb4c-4044-bb0a-49c5c2fb10ff tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:50.187487 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec231296-bb4c-4044-bb0a-49c5c2fb10ff tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:50.187973 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec231296-bb4c-4044-bb0a-49c5c2fb10ff tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:50.188402 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec231296-bb4c-4044-bb0a-49c5c2fb10ff tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:50.350000 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ec231296-bb4c-4044-bb0a-49c5c2fb10ff tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:50.358042 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ec231296-bb4c-4044-bb0a-49c5c2fb10ff tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.183649 Sep 14 01:07:50.358728 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 213/448] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:50 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:51.381242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2e899347-916e-430f-a12b-d3eb98f4b036 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:51.381809 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2e899347-916e-430f-a12b-d3eb98f4b036 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:51.387523 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2e899347-916e-430f-a12b-d3eb98f4b036 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:51.388313 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2e899347-916e-430f-a12b-d3eb98f4b036 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:51.388740 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2e899347-916e-430f-a12b-d3eb98f4b036 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:51.389420 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2e899347-916e-430f-a12b-d3eb98f4b036 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:51.389865 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2e899347-916e-430f-a12b-d3eb98f4b036 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:51.390281 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2e899347-916e-430f-a12b-d3eb98f4b036 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:51.535969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2e899347-916e-430f-a12b-d3eb98f4b036 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:51.544507 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2e899347-916e-430f-a12b-d3eb98f4b036 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.167298 Sep 14 01:07:51.545083 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 236/449] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:51 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:52.429616 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-8bdad53d-57f5-4f5e-84d5-2989a9e0c19a req-52344484-62b4-453d-84a6-c9427728a5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413d7106-fff0-4516-b70d-1d687312c9aa", "name": "network-vif-plugged", "status": "completed", "tag": "41e3c7ae-c1a9-4785-bdec-300c125b2082"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:07:52.441438 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-8bdad53d-57f5-4f5e-84d5-2989a9e0c19a req-52344484-62b4-453d-84a6-c9427728a5d5 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:52.442258 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-8bdad53d-57f5-4f5e-84d5-2989a9e0c19a req-52344484-62b4-453d-84a6-c9427728a5d5 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:52.442857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-8bdad53d-57f5-4f5e-84d5-2989a9e0c19a req-52344484-62b4-453d-84a6-c9427728a5d5 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:52.464581 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-8bdad53d-57f5-4f5e-84d5-2989a9e0c19a req-52344484-62b4-453d-84a6-c9427728a5d5 service nova] Creating event network-vif-plugged:41e3c7ae-c1a9-4785-bdec-300c125b2082 for instance 413d7106-fff0-4516-b70d-1d687312c9aa on hv-cinder-85752 Sep 14 01:07:52.469700 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-8bdad53d-57f5-4f5e-84d5-2989a9e0c19a req-52344484-62b4-453d-84a6-c9427728a5d5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044412 Sep 14 01:07:52.470542 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 214/450] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:07:52.568392 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6ab07f7b-41d9-42ac-8852-d06e17c0fbca tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:52.569080 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6ab07f7b-41d9-42ac-8852-d06e17c0fbca tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:52.575066 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ab07f7b-41d9-42ac-8852-d06e17c0fbca tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:52.575545 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ab07f7b-41d9-42ac-8852-d06e17c0fbca tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:52.576030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ab07f7b-41d9-42ac-8852-d06e17c0fbca tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:52.576690 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ab07f7b-41d9-42ac-8852-d06e17c0fbca tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:52.577142 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ab07f7b-41d9-42ac-8852-d06e17c0fbca tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:52.577564 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ab07f7b-41d9-42ac-8852-d06e17c0fbca tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:52.715298 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6ab07f7b-41d9-42ac-8852-d06e17c0fbca tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:52.724959 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6ab07f7b-41d9-42ac-8852-d06e17c0fbca tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.160473 Sep 14 01:07:52.725519 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 237/451] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:52 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:53.749708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-36f8a715-9cfd-4a20-a304-c16fa323ea75 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:53.750328 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-36f8a715-9cfd-4a20-a304-c16fa323ea75 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:53.757299 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-36f8a715-9cfd-4a20-a304-c16fa323ea75 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:53.757789 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-36f8a715-9cfd-4a20-a304-c16fa323ea75 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:53.758233 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-36f8a715-9cfd-4a20-a304-c16fa323ea75 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:53.758957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-36f8a715-9cfd-4a20-a304-c16fa323ea75 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:53.759418 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-36f8a715-9cfd-4a20-a304-c16fa323ea75 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:53.759935 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-36f8a715-9cfd-4a20-a304-c16fa323ea75 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:53.890318 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-36f8a715-9cfd-4a20-a304-c16fa323ea75 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:53.897876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-36f8a715-9cfd-4a20-a304-c16fa323ea75 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1369 microversion: 2.1 time: 0.153193 Sep 14 01:07:53.898434 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 215/452] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:53 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:54.920774 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0298e86b-16a6-4350-b55e-339fab88a289 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:54.921410 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0298e86b-16a6-4350-b55e-339fab88a289 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:54.927508 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0298e86b-16a6-4350-b55e-339fab88a289 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:54.928015 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0298e86b-16a6-4350-b55e-339fab88a289 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:54.928445 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0298e86b-16a6-4350-b55e-339fab88a289 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:54.929121 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0298e86b-16a6-4350-b55e-339fab88a289 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:54.929569 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0298e86b-16a6-4350-b55e-339fab88a289 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:54.929986 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0298e86b-16a6-4350-b55e-339fab88a289 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:55.058299 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0298e86b-16a6-4350-b55e-339fab88a289 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:07:55.066801 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0298e86b-16a6-4350-b55e-339fab88a289 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1564 microversion: 2.1 time: 0.149343 Sep 14 01:07:55.067361 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 238/453] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:07:54 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1564 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:07:55.089201 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-40afe705-a725-4017-b15a-a49c9f0b788c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:07:55.089710 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-40afe705-a725-4017-b15a-a49c9f0b788c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:07:55.096040 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-40afe705-a725-4017-b15a-a49c9f0b788c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:55.096524 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-40afe705-a725-4017-b15a-a49c9f0b788c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:55.096961 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-40afe705-a725-4017-b15a-a49c9f0b788c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:55.097771 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-40afe705-a725-4017-b15a-a49c9f0b788c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:55.098227 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-40afe705-a725-4017-b15a-a49c9f0b788c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:55.098678 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-40afe705-a725-4017-b15a-a49c9f0b788c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:55.174675 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-40afe705-a725-4017-b15a-a49c9f0b788c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089284 Sep 14 01:07:55.176425 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 216/454] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Sep 14 01:07:55 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:07:56.392574 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-5f7a56f4-28d4-4dae-911b-60c5bbb82984 req-8fe04432-7393-4ba0-a781-3c0c59f72d1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "413d7106-fff0-4516-b70d-1d687312c9aa", "tag": "41e3c7ae-c1a9-4785-bdec-300c125b2082"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:07:56.406857 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-5f7a56f4-28d4-4dae-911b-60c5bbb82984 req-8fe04432-7393-4ba0-a781-3c0c59f72d1f service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:07:56.407330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-5f7a56f4-28d4-4dae-911b-60c5bbb82984 req-8fe04432-7393-4ba0-a781-3c0c59f72d1f service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:07:56.414654 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-5f7a56f4-28d4-4dae-911b-60c5bbb82984 req-8fe04432-7393-4ba0-a781-3c0c59f72d1f service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:07:56.428743 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-5f7a56f4-28d4-4dae-911b-60c5bbb82984 req-8fe04432-7393-4ba0-a781-3c0c59f72d1f service nova] Creating event network-changed:41e3c7ae-c1a9-4785-bdec-300c125b2082 for instance 413d7106-fff0-4516-b70d-1d687312c9aa on hv-cinder-85752 Sep 14 01:07:56.434182 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-5f7a56f4-28d4-4dae-911b-60c5bbb82984 req-8fe04432-7393-4ba0-a781-3c0c59f72d1f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045194 Sep 14 01:07:56.434776 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 239/455] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:08:10.534448 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=19 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:08:10.535197 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=70 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:08:10.539756 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-5c786b8d-f2aa-420b-b5de-2990f2e9feeb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50ab82e8-2437-490f-b62a-e2df8eb3a8b0", "device": "/dev/sdb"}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:08:10.542586 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-5c786b8d-f2aa-420b-b5de-2990f2e9feeb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:08:10.549332 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5c786b8d-f2aa-420b-b5de-2990f2e9feeb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:10.550471 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5c786b8d-f2aa-420b-b5de-2990f2e9feeb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:10.550911 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5c786b8d-f2aa-420b-b5de-2990f2e9feeb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:10.551626 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5c786b8d-f2aa-420b-b5de-2990f2e9feeb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:10.552090 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5c786b8d-f2aa-420b-b5de-2990f2e9feeb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:10.552513 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5c786b8d-f2aa-420b-b5de-2990f2e9feeb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:10.817911 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-5c786b8d-f2aa-420b-b5de-2990f2e9feeb tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "POST /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284874 Sep 14 01:08:10.818515 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 217/456] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 01:08:10 2022] POST /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:08:46.760696 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7225d20e-bdda-47e3-ad95-2873a5310f16 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2084228149", "imageRef": "a2619027-0d8b-4ca3-9528-1ac3380cab5a", "flavorRef": "452"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:08:46.767894 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=15 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:08:46.768555 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=25 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:08:46.770232 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 01:08:46.770364 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Wed Sep 14 01:08:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Sep 14 01:08:46.818526 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-7225d20e-bdda-47e3-ad95-2873a5310f16 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] validate_networks() for None {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:08:46.996348 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=2 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:08:46.997191 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:08:47.002186 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7cc011d0-9c95-4638-95e4-61319efb677a tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:08:47.002784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7cc011d0-9c95-4638-95e4-61319efb677a tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:08:47.010662 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7cc011d0-9c95-4638-95e4-61319efb677a tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:47.011181 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7cc011d0-9c95-4638-95e4-61319efb677a tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:47.011648 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7cc011d0-9c95-4638-95e4-61319efb677a tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:47.012617 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7cc011d0-9c95-4638-95e4-61319efb677a tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:47.013079 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7cc011d0-9c95-4638-95e4-61319efb677a tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:47.013507 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7cc011d0-9c95-4638-95e4-61319efb677a tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:47.092564 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-7225d20e-bdda-47e3-ad95-2873a5310f16 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:08:47.092980 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-7225d20e-bdda-47e3-ad95-2873a5310f16 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:08:47.093446 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-7225d20e-bdda-47e3-ad95-2873a5310f16 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:08:47.093848 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-7225d20e-bdda-47e3-ad95-2873a5310f16 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:08:47.094498 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-7225d20e-bdda-47e3-ad95-2873a5310f16 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:08:47.103833 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7225d20e-bdda-47e3-ad95-2873a5310f16 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:47.104339 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7225d20e-bdda-47e3-ad95-2873a5310f16 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:47.104769 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7225d20e-bdda-47e3-ad95-2873a5310f16 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:47.105508 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7225d20e-bdda-47e3-ad95-2873a5310f16 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:47.105954 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7225d20e-bdda-47e3-ad95-2873a5310f16 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:47.106372 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7225d20e-bdda-47e3-ad95-2873a5310f16 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:47.123705 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-7225d20e-bdda-47e3-ad95-2873a5310f16 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Getting quotas for project c3a4cb96eea945b8aeabe1ee77293241. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:08:47.127900 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-7225d20e-bdda-47e3-ad95-2873a5310f16 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Getting quotas for user 933fbde6e9e0421eb7da2b7bd7850b84 and project c3a4cb96eea945b8aeabe1ee77293241. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:08:47.140146 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7225d20e-bdda-47e3-ad95-2873a5310f16 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:08:47.142642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7225d20e-bdda-47e3-ad95-2873a5310f16 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a2619027-0d8b-4ca3-9528-1ac3380cab5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:08:47.143640 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-7cc011d0-9c95-4638-95e4-61319efb677a tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lazy-loading 'services' on Instance uuid bd1b7018-c9a6-4ee8-876b-8c701b568fac {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:08:47.188865 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7225d20e-bdda-47e3-ad95-2873a5310f16 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.432215 Sep 14 01:08:47.189659 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 240/457] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 01:08:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 01:08:47.200622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f4aea1d6-6419-4062-a23d-8ce75589c4ae tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:08:47.201242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f4aea1d6-6419-4062-a23d-8ce75589c4ae tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:08:47.264693 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f4aea1d6-6419-4062-a23d-8ce75589c4ae tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:08:47.266420 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7cc011d0-9c95-4638-95e4-61319efb677a tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac/os-volume_attachments/50ab82e8-2437-490f-b62a-e2df8eb3a8b0" status: 202 len: 0 microversion: 2.1 time: 0.271863 Sep 14 01:08:47.267145 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 218/458] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 01:08:46 2022] DELETE /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac/os-volume_attachments/50ab82e8-2437-490f-b62a-e2df8eb3a8b0 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 01:08:47.278515 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f4aea1d6-6419-4062-a23d-8ce75589c4ae tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1215 microversion: 2.1 time: 0.081592 Sep 14 01:08:47.288193 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 241/459] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:08:47 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:08:48.303795 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e5a94ac5-30d4-473a-9a6b-d8e7f46b461a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:08:48.304485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-e5a94ac5-30d4-473a-9a6b-d8e7f46b461a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:08:48.310608 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e5a94ac5-30d4-473a-9a6b-d8e7f46b461a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:48.311089 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e5a94ac5-30d4-473a-9a6b-d8e7f46b461a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:48.311542 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e5a94ac5-30d4-473a-9a6b-d8e7f46b461a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:48.312241 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e5a94ac5-30d4-473a-9a6b-d8e7f46b461a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:48.312692 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e5a94ac5-30d4-473a-9a6b-d8e7f46b461a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:48.313111 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e5a94ac5-30d4-473a-9a6b-d8e7f46b461a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:48.377365 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e5a94ac5-30d4-473a-9a6b-d8e7f46b461a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:08:48.385301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-e5a94ac5-30d4-473a-9a6b-d8e7f46b461a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1211 microversion: 2.1 time: 0.086843 Sep 14 01:08:48.385858 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 219/460] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:08:48 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:08:49.408258 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fdaf95ed-c02d-40f1-a5e2-a10c2c7b9fb6 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:08:49.408925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fdaf95ed-c02d-40f1-a5e2-a10c2c7b9fb6 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:08:49.415796 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fdaf95ed-c02d-40f1-a5e2-a10c2c7b9fb6 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:49.416329 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fdaf95ed-c02d-40f1-a5e2-a10c2c7b9fb6 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:49.416783 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fdaf95ed-c02d-40f1-a5e2-a10c2c7b9fb6 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:49.417479 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fdaf95ed-c02d-40f1-a5e2-a10c2c7b9fb6 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:49.417929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fdaf95ed-c02d-40f1-a5e2-a10c2c7b9fb6 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:49.418350 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fdaf95ed-c02d-40f1-a5e2-a10c2c7b9fb6 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:49.467103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2b76abf8-b412-4a65-a52a-ea0df4183303 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:08:49.468303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2b76abf8-b412-4a65-a52a-ea0df4183303 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:08:49.475260 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2b76abf8-b412-4a65-a52a-ea0df4183303 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:49.476071 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2b76abf8-b412-4a65-a52a-ea0df4183303 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:49.476772 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2b76abf8-b412-4a65-a52a-ea0df4183303 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:49.477712 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2b76abf8-b412-4a65-a52a-ea0df4183303 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:49.478441 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2b76abf8-b412-4a65-a52a-ea0df4183303 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:49.479055 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2b76abf8-b412-4a65-a52a-ea0df4183303 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:49.483095 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fdaf95ed-c02d-40f1-a5e2-a10c2c7b9fb6 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:08:49.492381 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fdaf95ed-c02d-40f1-a5e2-a10c2c7b9fb6 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1267 microversion: 2.1 time: 0.088251 Sep 14 01:08:49.495586 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 242/461] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:08:49 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:08:49.508191 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2b76abf8-b412-4a65-a52a-ea0df4183303 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Going to try to terminate instance {{(pid=120620) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:08:49.588054 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2b76abf8-b412-4a65-a52a-ea0df4183303 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 204 len: 0 microversion: 2.1 time: 0.124128 Sep 14 01:08:49.589228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 220/462] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:08:49 2022] DELETE /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 01:08:49.598005 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4e3b61ba-a0ee-413c-8d57-e9d24baaa4ef tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:08:49.598733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4e3b61ba-a0ee-413c-8d57-e9d24baaa4ef tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:08:49.604715 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4e3b61ba-a0ee-413c-8d57-e9d24baaa4ef tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:49.605199 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4e3b61ba-a0ee-413c-8d57-e9d24baaa4ef tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:49.605625 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4e3b61ba-a0ee-413c-8d57-e9d24baaa4ef tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:49.606310 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4e3b61ba-a0ee-413c-8d57-e9d24baaa4ef tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:49.606757 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4e3b61ba-a0ee-413c-8d57-e9d24baaa4ef tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:49.607175 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4e3b61ba-a0ee-413c-8d57-e9d24baaa4ef tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:49.741149 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4e3b61ba-a0ee-413c-8d57-e9d24baaa4ef tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:08:49.748858 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4e3b61ba-a0ee-413c-8d57-e9d24baaa4ef tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1511 microversion: 2.1 time: 0.155223 Sep 14 01:08:49.749426 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 243/463] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:08:49 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:08:50.516390 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a80529cd-ad03-4fa0-836f-1026cf02f492 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:08:50.517119 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a80529cd-ad03-4fa0-836f-1026cf02f492 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:08:50.524555 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a80529cd-ad03-4fa0-836f-1026cf02f492 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:50.525013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a80529cd-ad03-4fa0-836f-1026cf02f492 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:50.525444 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a80529cd-ad03-4fa0-836f-1026cf02f492 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:50.526126 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a80529cd-ad03-4fa0-836f-1026cf02f492 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:50.526576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a80529cd-ad03-4fa0-836f-1026cf02f492 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:50.526997 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a80529cd-ad03-4fa0-836f-1026cf02f492 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:50.597583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a80529cd-ad03-4fa0-836f-1026cf02f492 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:08:50.605163 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a80529cd-ad03-4fa0-836f-1026cf02f492 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1267 microversion: 2.1 time: 0.093364 Sep 14 01:08:50.605737 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 221/464] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:08:50 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:08:50.773420 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-20356d6f-13fa-416d-95ea-8d8bb668dbc1 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:08:50.774025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-20356d6f-13fa-416d-95ea-8d8bb668dbc1 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:08:50.779990 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-20356d6f-13fa-416d-95ea-8d8bb668dbc1 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:50.780406 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-20356d6f-13fa-416d-95ea-8d8bb668dbc1 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:50.780833 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-20356d6f-13fa-416d-95ea-8d8bb668dbc1 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:50.781504 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-20356d6f-13fa-416d-95ea-8d8bb668dbc1 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:50.781949 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-20356d6f-13fa-416d-95ea-8d8bb668dbc1 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:50.782365 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-20356d6f-13fa-416d-95ea-8d8bb668dbc1 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:50.910025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-20356d6f-13fa-416d-95ea-8d8bb668dbc1 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:08:50.917548 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-20356d6f-13fa-416d-95ea-8d8bb668dbc1 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1511 microversion: 2.1 time: 0.148862 Sep 14 01:08:50.918109 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 244/465] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:08:50 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:08:51.629819 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9b124c9f-a6de-4f40-8049-42d2ec8a2b99 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:08:51.630729 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9b124c9f-a6de-4f40-8049-42d2ec8a2b99 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:08:51.638644 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9b124c9f-a6de-4f40-8049-42d2ec8a2b99 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:51.639312 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9b124c9f-a6de-4f40-8049-42d2ec8a2b99 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:51.640046 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9b124c9f-a6de-4f40-8049-42d2ec8a2b99 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:51.640965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9b124c9f-a6de-4f40-8049-42d2ec8a2b99 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:51.641425 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9b124c9f-a6de-4f40-8049-42d2ec8a2b99 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:51.641849 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9b124c9f-a6de-4f40-8049-42d2ec8a2b99 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:51.758260 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9b124c9f-a6de-4f40-8049-42d2ec8a2b99 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:08:51.766119 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9b124c9f-a6de-4f40-8049-42d2ec8a2b99 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1273 microversion: 2.1 time: 0.141898 Sep 14 01:08:51.766692 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 222/466] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:08:51 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1273 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:08:51.941321 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9303e053-c117-436a-aa70-78141a975ae9 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:08:51.941938 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9303e053-c117-436a-aa70-78141a975ae9 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:08:51.947835 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9303e053-c117-436a-aa70-78141a975ae9 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:51.948317 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9303e053-c117-436a-aa70-78141a975ae9 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:51.948754 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9303e053-c117-436a-aa70-78141a975ae9 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:51.949441 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9303e053-c117-436a-aa70-78141a975ae9 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:51.949899 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9303e053-c117-436a-aa70-78141a975ae9 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:51.950831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9303e053-c117-436a-aa70-78141a975ae9 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:52.080612 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9303e053-c117-436a-aa70-78141a975ae9 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:08:52.088930 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9303e053-c117-436a-aa70-78141a975ae9 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1511 microversion: 2.1 time: 0.151524 Sep 14 01:08:52.089498 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 245/467] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:08:51 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:08:52.790335 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4d0afd61-419b-4756-ad12-18e9c9eea918 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:08:52.790938 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4d0afd61-419b-4756-ad12-18e9c9eea918 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:08:52.797802 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d0afd61-419b-4756-ad12-18e9c9eea918 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:52.798291 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d0afd61-419b-4756-ad12-18e9c9eea918 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:52.798780 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d0afd61-419b-4756-ad12-18e9c9eea918 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:52.799515 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d0afd61-419b-4756-ad12-18e9c9eea918 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:52.800831 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d0afd61-419b-4756-ad12-18e9c9eea918 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:52.801478 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d0afd61-419b-4756-ad12-18e9c9eea918 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:52.893932 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4d0afd61-419b-4756-ad12-18e9c9eea918 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:08:52.902079 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-77c35d77-11a7-4df5-9c60-d9c268f806e8 req-b8a9d210-019e-4431-b9ea-d563459605d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd1b7018-c9a6-4ee8-876b-8c701b568fac", "name": "network-vif-deleted", "tag": "a24cbf5e-9696-4465-8ed2-8a2847a7e4ac"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:08:52.912683 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-77c35d77-11a7-4df5-9c60-d9c268f806e8 req-b8a9d210-019e-4431-b9ea-d563459605d8 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:52.913164 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-77c35d77-11a7-4df5-9c60-d9c268f806e8 req-b8a9d210-019e-4431-b9ea-d563459605d8 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:52.913595 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-77c35d77-11a7-4df5-9c60-d9c268f806e8 req-b8a9d210-019e-4431-b9ea-d563459605d8 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:52.914449 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4d0afd61-419b-4756-ad12-18e9c9eea918 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1273 microversion: 2.1 time: 0.128006 Sep 14 01:08:52.927928 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 223/468] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:08:52 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:08:52.939418 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-77c35d77-11a7-4df5-9c60-d9c268f806e8 req-b8a9d210-019e-4431-b9ea-d563459605d8 service nova] Creating event network-vif-deleted:a24cbf5e-9696-4465-8ed2-8a2847a7e4ac for instance bd1b7018-c9a6-4ee8-876b-8c701b568fac on hv-cinder-85752 Sep 14 01:08:52.946410 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-77c35d77-11a7-4df5-9c60-d9c268f806e8 req-b8a9d210-019e-4431-b9ea-d563459605d8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047524 Sep 14 01:08:52.947184 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 246/469] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:08:53.114198 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-63772587-bb83-4d57-9e08-86af0e6a81b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:08:53.114747 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-63772587-bb83-4d57-9e08-86af0e6a81b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:08:53.120807 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-63772587-bb83-4d57-9e08-86af0e6a81b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:53.121217 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-63772587-bb83-4d57-9e08-86af0e6a81b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:53.121668 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-63772587-bb83-4d57-9e08-86af0e6a81b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:53.122368 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-63772587-bb83-4d57-9e08-86af0e6a81b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:53.123770 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-63772587-bb83-4d57-9e08-86af0e6a81b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:53.124268 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-63772587-bb83-4d57-9e08-86af0e6a81b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:53.162546 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-63772587-bb83-4d57-9e08-86af0e6a81b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:53.163038 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-63772587-bb83-4d57-9e08-86af0e6a81b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:53.163475 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-63772587-bb83-4d57-9e08-86af0e6a81b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:53.163956 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-63772587-bb83-4d57-9e08-86af0e6a81b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lazy-loading 'fault' on Instance uuid bd1b7018-c9a6-4ee8-876b-8c701b568fac {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:08:53.233263 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-63772587-bb83-4d57-9e08-86af0e6a81b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:08:53.244279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-63772587-bb83-4d57-9e08-86af0e6a81b6 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 200 len: 1308 microversion: 2.1 time: 0.135129 Sep 14 01:08:53.245238 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 224/470] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:08:53 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 1308 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:08:53.940197 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-85a1e732-3ffe-43ca-9919-a9dc9ef6a926 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:08:53.940898 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-85a1e732-3ffe-43ca-9919-a9dc9ef6a926 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:08:53.947136 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85a1e732-3ffe-43ca-9919-a9dc9ef6a926 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:53.948328 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85a1e732-3ffe-43ca-9919-a9dc9ef6a926 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:53.948934 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85a1e732-3ffe-43ca-9919-a9dc9ef6a926 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:53.949799 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85a1e732-3ffe-43ca-9919-a9dc9ef6a926 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:53.950250 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85a1e732-3ffe-43ca-9919-a9dc9ef6a926 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:53.950667 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85a1e732-3ffe-43ca-9919-a9dc9ef6a926 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:54.038039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-f9d6d0bd-9bcf-42cf-8c64-22db96acf282 req-3c2b6153-97db-47c3-91b4-77b9dc088423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23077ed0-85ab-48fb-a533-9a0f035f29c8", "tag": "21627f84-f88e-4d81-bd53-27fd3579600b"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:08:54.058905 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-f9d6d0bd-9bcf-42cf-8c64-22db96acf282 req-3c2b6153-97db-47c3-91b4-77b9dc088423 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:54.059437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-f9d6d0bd-9bcf-42cf-8c64-22db96acf282 req-3c2b6153-97db-47c3-91b4-77b9dc088423 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:54.060189 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-f9d6d0bd-9bcf-42cf-8c64-22db96acf282 req-3c2b6153-97db-47c3-91b4-77b9dc088423 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:54.082663 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-f9d6d0bd-9bcf-42cf-8c64-22db96acf282 req-3c2b6153-97db-47c3-91b4-77b9dc088423 service nova] Creating event network-changed:21627f84-f88e-4d81-bd53-27fd3579600b for instance 23077ed0-85ab-48fb-a533-9a0f035f29c8 on hv-cinder-85752 Sep 14 01:08:54.090299 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-f9d6d0bd-9bcf-42cf-8c64-22db96acf282 req-3c2b6153-97db-47c3-91b4-77b9dc088423 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061251 Sep 14 01:08:54.091423 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 225/471] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:08:54.133500 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-85a1e732-3ffe-43ca-9919-a9dc9ef6a926 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:08:54.142151 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-85a1e732-3ffe-43ca-9919-a9dc9ef6a926 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.207548 Sep 14 01:08:54.142920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 247/472] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:08:53 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:08:54.269485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-3b40a37c-6f8d-496a-8c8e-752bce4a15e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:08:54.270191 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-3b40a37c-6f8d-496a-8c8e-752bce4a15e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: bd1b7018-c9a6-4ee8-876b-8c701b568fac] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:08:54.276805 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3b40a37c-6f8d-496a-8c8e-752bce4a15e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:54.277328 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3b40a37c-6f8d-496a-8c8e-752bce4a15e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:54.277724 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3b40a37c-6f8d-496a-8c8e-752bce4a15e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:54.278615 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3b40a37c-6f8d-496a-8c8e-752bce4a15e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:54.279079 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3b40a37c-6f8d-496a-8c8e-752bce4a15e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:54.279507 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3b40a37c-6f8d-496a-8c8e-752bce4a15e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:54.295141 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-3b40a37c-6f8d-496a-8c8e-752bce4a15e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] HTTP exception thrown: Instance bd1b7018-c9a6-4ee8-876b-8c701b568fac could not be found. Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-3b40a37c-6f8d-496a-8c8e-752bce4a15e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Request method failure captured: Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac HTTP/1.1 Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISkh_6E9az3wywkVPrUXZH9Gl-DMT6gXnua5-IzuE60YJIb9ZxPYiaTJTwXbAkZUIfN1ucKfYM-TcJcgxN2AmHRg14aD7jcV8RczjQ6W7bj0GlyjK-TAZAJ0m5oZOZhDkKdfyAlswAI7s7rR2D_shWBBwagy9i9crSStczXXr6WAGOk Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 0f8eb4de1820448eb1064b0fbb45a259 Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-VolumesSnapshotTestJSON-190046587 Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:08:54.296827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:08:54.298329 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0f8eb4de1820448eb1064b0fbb45a259"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0f8eb4de1820448eb1064b0fbb45a259"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0f8eb4de1820448eb1064b0fbb45a259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0f8eb4de1820448eb1064b0fbb45a259"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:08:54.298329 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-VolumesSnapshotTestJSON-190046587 Sep 14 01:08:54.298329 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 0f8eb4de1820448eb1064b0fbb45a259 Sep 14 01:08:54.298329 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-190046587 Sep 14 01:08:54.298329 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-VolumesSnapshotTestJSON-190046587-project Sep 14 01:08:54.298329 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:08:54.298329 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:08:54.298329 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: 0b9c17d96f3d44589cee145c8ec2e97d Sep 14 01:08:54.298329 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-VolumesSnapshotTestJSON-190046587-project Sep 14 01:08:54.298329 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:08:54.298329 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance bd1b7018-c9a6-4ee8-876b-8c701b568fac could not be found. Sep 14 01:08:54.298329 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': 'bd1b7018-c9a6-4ee8-876b-8c701b568fac'} Sep 14 01:08:54.299286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:08:54.299286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:08:54.299286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:08:54.299286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:08:54.299286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:08:54.299286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:08:54.299286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:08:54.299286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:08:54.299286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:08:54.299286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:08:54.299286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd1b7018-c9a6-4ee8-876b-8c701b568fac could not be found. Sep 14 01:08:54.299286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:08:54.299286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:08:54.299286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:08:54.299286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:08:54.299286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:08:54.299286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:08:54.299286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:08:54.299286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:08:54.299286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:08:54.300806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:08:54.300806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:08:54.300806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:08:54.300806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:08:54.300806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:08:54.300806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:08:54.300806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:08:54.300806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd1b7018-c9a6-4ee8-876b-8c701b568fac could not be found. Sep 14 01:08:54.300806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:08:54.300806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:08:54.300806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:08:54.300806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:08:54.300806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:08:54.300806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:08:54.300806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:08:54.300806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:08:54.300806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd1b7018-c9a6-4ee8-876b-8c701b568fac could not be found. Sep 14 01:08:54.300806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:08:54.302591 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-3b40a37c-6f8d-496a-8c8e-752bce4a15e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Returning 404 to user: Instance bd1b7018-c9a6-4ee8-876b-8c701b568fac could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:08:54.302591 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-3b40a37c-6f8d-496a-8c8e-752bce4a15e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac" status: 404 len: 111 microversion: 2.1 time: 0.033786 Sep 14 01:08:54.302591 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 226/473] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:08:54 2022] GET /compute/v2.1/servers/bd1b7018-c9a6-4ee8-876b-8c701b568fac => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:08:55.166059 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-05f85b16-0d48-4d25-8b2a-cbab0120426c tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:08:55.166668 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-05f85b16-0d48-4d25-8b2a-cbab0120426c tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:08:55.172806 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-05f85b16-0d48-4d25-8b2a-cbab0120426c tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:55.173289 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-05f85b16-0d48-4d25-8b2a-cbab0120426c tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:55.173719 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-05f85b16-0d48-4d25-8b2a-cbab0120426c tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:55.174482 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-05f85b16-0d48-4d25-8b2a-cbab0120426c tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:55.175025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-05f85b16-0d48-4d25-8b2a-cbab0120426c tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:55.175440 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-05f85b16-0d48-4d25-8b2a-cbab0120426c tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:55.303914 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-05f85b16-0d48-4d25-8b2a-cbab0120426c tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:08:55.311538 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-05f85b16-0d48-4d25-8b2a-cbab0120426c tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.149369 Sep 14 01:08:55.312152 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 248/474] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:08:55 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:08:56.335315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-afc69fc8-b9b1-4d6b-a51f-4b025911f437 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:08:56.335977 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-afc69fc8-b9b1-4d6b-a51f-4b025911f437 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:08:56.342316 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-afc69fc8-b9b1-4d6b-a51f-4b025911f437 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:56.342788 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-afc69fc8-b9b1-4d6b-a51f-4b025911f437 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:56.343219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-afc69fc8-b9b1-4d6b-a51f-4b025911f437 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:56.344014 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-afc69fc8-b9b1-4d6b-a51f-4b025911f437 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:56.344460 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-afc69fc8-b9b1-4d6b-a51f-4b025911f437 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:56.344874 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-afc69fc8-b9b1-4d6b-a51f-4b025911f437 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:56.475341 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-afc69fc8-b9b1-4d6b-a51f-4b025911f437 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:08:56.483079 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-afc69fc8-b9b1-4d6b-a51f-4b025911f437 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.151555 Sep 14 01:08:56.483651 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 227/475] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:08:56 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:08:57.505814 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a33022b4-bc8a-4677-b592-93c96511db2a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:08:57.506418 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a33022b4-bc8a-4677-b592-93c96511db2a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:08:57.508392 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:08:57.509288 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=8 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:08:57.515759 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a33022b4-bc8a-4677-b592-93c96511db2a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:57.516248 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a33022b4-bc8a-4677-b592-93c96511db2a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:57.516674 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a33022b4-bc8a-4677-b592-93c96511db2a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:57.517355 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a33022b4-bc8a-4677-b592-93c96511db2a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:57.517806 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a33022b4-bc8a-4677-b592-93c96511db2a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:57.518230 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a33022b4-bc8a-4677-b592-93c96511db2a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:57.649656 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a33022b4-bc8a-4677-b592-93c96511db2a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:08:57.657533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a33022b4-bc8a-4677-b592-93c96511db2a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.155700 Sep 14 01:08:57.658077 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 249/476] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:08:57 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:08:58.681464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d79a2880-7e0f-4f8c-8f09-463cb0dc5cc9 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:08:58.682069 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d79a2880-7e0f-4f8c-8f09-463cb0dc5cc9 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:08:58.688844 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d79a2880-7e0f-4f8c-8f09-463cb0dc5cc9 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:58.689337 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d79a2880-7e0f-4f8c-8f09-463cb0dc5cc9 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:58.689823 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d79a2880-7e0f-4f8c-8f09-463cb0dc5cc9 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:58.691146 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d79a2880-7e0f-4f8c-8f09-463cb0dc5cc9 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:58.691596 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d79a2880-7e0f-4f8c-8f09-463cb0dc5cc9 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:58.692029 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d79a2880-7e0f-4f8c-8f09-463cb0dc5cc9 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:58.823187 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d79a2880-7e0f-4f8c-8f09-463cb0dc5cc9 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:08:58.830862 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d79a2880-7e0f-4f8c-8f09-463cb0dc5cc9 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.153267 Sep 14 01:08:58.831410 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 228/477] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:08:58 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:08:59.854618 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-729eeb17-af6f-475c-8c9b-a5703f9fa5ff tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:08:59.855004 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-729eeb17-af6f-475c-8c9b-a5703f9fa5ff tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:08:59.860529 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-729eeb17-af6f-475c-8c9b-a5703f9fa5ff tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:59.861015 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-729eeb17-af6f-475c-8c9b-a5703f9fa5ff tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:59.861452 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-729eeb17-af6f-475c-8c9b-a5703f9fa5ff tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:59.862221 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-729eeb17-af6f-475c-8c9b-a5703f9fa5ff tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:08:59.862687 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-729eeb17-af6f-475c-8c9b-a5703f9fa5ff tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:08:59.863109 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-729eeb17-af6f-475c-8c9b-a5703f9fa5ff tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:08:59.995876 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-729eeb17-af6f-475c-8c9b-a5703f9fa5ff tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:00.004180 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-729eeb17-af6f-475c-8c9b-a5703f9fa5ff tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.154002 Sep 14 01:09:00.004821 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 250/478] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:08:59 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:01.028708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8024a8ee-d4f4-4d3c-bafe-be479e744f84 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:01.029148 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8024a8ee-d4f4-4d3c-bafe-be479e744f84 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:01.038209 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8024a8ee-d4f4-4d3c-bafe-be479e744f84 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:01.038704 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8024a8ee-d4f4-4d3c-bafe-be479e744f84 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:01.039157 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8024a8ee-d4f4-4d3c-bafe-be479e744f84 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:01.039896 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8024a8ee-d4f4-4d3c-bafe-be479e744f84 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:01.040577 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8024a8ee-d4f4-4d3c-bafe-be479e744f84 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:01.041495 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8024a8ee-d4f4-4d3c-bafe-be479e744f84 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:01.206096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8024a8ee-d4f4-4d3c-bafe-be479e744f84 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:01.213746 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8024a8ee-d4f4-4d3c-bafe-be479e744f84 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.189849 Sep 14 01:09:01.214306 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 229/479] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:01 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:02.236163 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-85f66780-bb99-42bc-a7e8-252676ae13fd tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:02.236982 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-85f66780-bb99-42bc-a7e8-252676ae13fd tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:02.242834 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85f66780-bb99-42bc-a7e8-252676ae13fd tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:02.243307 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85f66780-bb99-42bc-a7e8-252676ae13fd tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:02.243810 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85f66780-bb99-42bc-a7e8-252676ae13fd tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:02.244505 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85f66780-bb99-42bc-a7e8-252676ae13fd tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:02.244952 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85f66780-bb99-42bc-a7e8-252676ae13fd tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:02.245367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85f66780-bb99-42bc-a7e8-252676ae13fd tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:02.372746 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-85f66780-bb99-42bc-a7e8-252676ae13fd tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:02.380268 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-85f66780-bb99-42bc-a7e8-252676ae13fd tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.147969 Sep 14 01:09:02.380826 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 251/480] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:02 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:03.403962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8f654b1c-2190-45aa-acba-e03a3d679ab5 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:03.404568 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8f654b1c-2190-45aa-acba-e03a3d679ab5 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:03.411170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8f654b1c-2190-45aa-acba-e03a3d679ab5 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:03.411704 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8f654b1c-2190-45aa-acba-e03a3d679ab5 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:03.412149 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8f654b1c-2190-45aa-acba-e03a3d679ab5 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:03.412845 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8f654b1c-2190-45aa-acba-e03a3d679ab5 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:03.413303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8f654b1c-2190-45aa-acba-e03a3d679ab5 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:03.413752 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8f654b1c-2190-45aa-acba-e03a3d679ab5 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:03.541504 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8f654b1c-2190-45aa-acba-e03a3d679ab5 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:03.549233 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8f654b1c-2190-45aa-acba-e03a3d679ab5 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.148956 Sep 14 01:09:03.549799 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 230/481] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:03 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:04.571879 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-858dbb91-3f70-43b4-b6ee-a403e04d8dc1 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:04.572488 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-858dbb91-3f70-43b4-b6ee-a403e04d8dc1 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:04.578370 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-858dbb91-3f70-43b4-b6ee-a403e04d8dc1 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:04.578855 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-858dbb91-3f70-43b4-b6ee-a403e04d8dc1 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:04.579290 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-858dbb91-3f70-43b4-b6ee-a403e04d8dc1 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:04.580018 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-858dbb91-3f70-43b4-b6ee-a403e04d8dc1 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:04.580982 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-858dbb91-3f70-43b4-b6ee-a403e04d8dc1 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:04.581401 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-858dbb91-3f70-43b4-b6ee-a403e04d8dc1 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:04.710412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-858dbb91-3f70-43b4-b6ee-a403e04d8dc1 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:04.718048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-858dbb91-3f70-43b4-b6ee-a403e04d8dc1 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.149981 Sep 14 01:09:04.718605 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 252/482] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:04 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:05.742417 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-58f6df6d-6a0d-499b-8915-0789d40c8420 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:05.742980 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-58f6df6d-6a0d-499b-8915-0789d40c8420 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:05.749349 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-58f6df6d-6a0d-499b-8915-0789d40c8420 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:05.749833 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-58f6df6d-6a0d-499b-8915-0789d40c8420 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:05.750290 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-58f6df6d-6a0d-499b-8915-0789d40c8420 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:05.750954 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-58f6df6d-6a0d-499b-8915-0789d40c8420 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:05.751409 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-58f6df6d-6a0d-499b-8915-0789d40c8420 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:05.751860 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-58f6df6d-6a0d-499b-8915-0789d40c8420 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:05.886670 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-58f6df6d-6a0d-499b-8915-0789d40c8420 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:05.895505 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-58f6df6d-6a0d-499b-8915-0789d40c8420 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.157015 Sep 14 01:09:05.896096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 231/483] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:05 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:06.383221 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6b893d2d-e23a-4f93-9245-ab63e54906fe tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2049151955", "imageRef": "a2619027-0d8b-4ca3-9528-1ac3380cab5a", "flavorRef": "452", "networks": [{"uuid": "3dab046e-a732-4523-8b50-a5cba6b7830d"}]}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:09:06.438806 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-6b893d2d-e23a-4f93-9245-ab63e54906fe tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] validate_networks() for [('3dab046e-a732-4523-8b50-a5cba6b7830d', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:09:06.801554 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-6b893d2d-e23a-4f93-9245-ab63e54906fe tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:09:06.801971 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-6b893d2d-e23a-4f93-9245-ab63e54906fe tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:09:06.802466 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-6b893d2d-e23a-4f93-9245-ab63e54906fe tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:09:06.802868 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-6b893d2d-e23a-4f93-9245-ab63e54906fe tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:09:06.803271 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-6b893d2d-e23a-4f93-9245-ab63e54906fe tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:09:06.811883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6b893d2d-e23a-4f93-9245-ab63e54906fe tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:06.812335 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6b893d2d-e23a-4f93-9245-ab63e54906fe tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:06.812765 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6b893d2d-e23a-4f93-9245-ab63e54906fe tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:06.813484 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6b893d2d-e23a-4f93-9245-ab63e54906fe tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:06.813934 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6b893d2d-e23a-4f93-9245-ab63e54906fe tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:06.814367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6b893d2d-e23a-4f93-9245-ab63e54906fe tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:06.831717 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-6b893d2d-e23a-4f93-9245-ab63e54906fe tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Getting quotas for project 0f8eb4de1820448eb1064b0fbb45a259. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:09:06.835633 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-6b893d2d-e23a-4f93-9245-ab63e54906fe tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Getting quotas for user 0b9c17d96f3d44589cee145c8ec2e97d and project 0f8eb4de1820448eb1064b0fbb45a259. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:09:06.847049 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6b893d2d-e23a-4f93-9245-ab63e54906fe tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:09:06.849335 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6b893d2d-e23a-4f93-9245-ab63e54906fe tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a2619027-0d8b-4ca3-9528-1ac3380cab5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:09:06.894657 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6b893d2d-e23a-4f93-9245-ab63e54906fe tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515198 Sep 14 01:09:06.895296 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 253/484] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 01:09:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 01:09:06.906489 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0162ecd2-8c57-4d1c-984b-03c85bf17d19 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:06.907112 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0162ecd2-8c57-4d1c-984b-03c85bf17d19 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:06.918226 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-21683ad0-eca5-4d73-acbe-3f8251ad07b2 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:06.919088 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-21683ad0-eca5-4d73-acbe-3f8251ad07b2 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:06.925868 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-21683ad0-eca5-4d73-acbe-3f8251ad07b2 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:06.926349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-21683ad0-eca5-4d73-acbe-3f8251ad07b2 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:06.927090 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-21683ad0-eca5-4d73-acbe-3f8251ad07b2 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:06.928004 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-21683ad0-eca5-4d73-acbe-3f8251ad07b2 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:06.928470 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-21683ad0-eca5-4d73-acbe-3f8251ad07b2 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:06.929570 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-21683ad0-eca5-4d73-acbe-3f8251ad07b2 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:06.979479 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0162ecd2-8c57-4d1c-984b-03c85bf17d19 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:06.987814 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0162ecd2-8c57-4d1c-984b-03c85bf17d19 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1219 microversion: 2.1 time: 0.085232 Sep 14 01:09:06.988907 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 232/485] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:06 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:07.081934 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-21683ad0-eca5-4d73-acbe-3f8251ad07b2 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:07.090045 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-21683ad0-eca5-4d73-acbe-3f8251ad07b2 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.175627 Sep 14 01:09:07.091064 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 254/486] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:06 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:08.012210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-c4c87910-5220-454b-a2ba-b4f1d7fcc27a tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:08.012817 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-c4c87910-5220-454b-a2ba-b4f1d7fcc27a tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:08.020661 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c4c87910-5220-454b-a2ba-b4f1d7fcc27a tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:08.021147 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c4c87910-5220-454b-a2ba-b4f1d7fcc27a tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:08.021582 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c4c87910-5220-454b-a2ba-b4f1d7fcc27a tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:08.022262 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c4c87910-5220-454b-a2ba-b4f1d7fcc27a tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:08.022713 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c4c87910-5220-454b-a2ba-b4f1d7fcc27a tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:08.023137 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c4c87910-5220-454b-a2ba-b4f1d7fcc27a tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:08.084279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c4c87910-5220-454b-a2ba-b4f1d7fcc27a tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:08.091713 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-c4c87910-5220-454b-a2ba-b4f1d7fcc27a tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1271 microversion: 2.1 time: 0.083706 Sep 14 01:09:08.092267 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 233/487] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:08 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:08.113650 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-66017dcc-eaa6-4f42-802a-9b6c2d9fd90b tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:08.114250 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-66017dcc-eaa6-4f42-802a-9b6c2d9fd90b tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:08.120065 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-66017dcc-eaa6-4f42-802a-9b6c2d9fd90b tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:08.120542 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-66017dcc-eaa6-4f42-802a-9b6c2d9fd90b tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:08.120966 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-66017dcc-eaa6-4f42-802a-9b6c2d9fd90b tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:08.121641 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-66017dcc-eaa6-4f42-802a-9b6c2d9fd90b tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:08.122087 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-66017dcc-eaa6-4f42-802a-9b6c2d9fd90b tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:08.122503 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-66017dcc-eaa6-4f42-802a-9b6c2d9fd90b tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:08.251032 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-66017dcc-eaa6-4f42-802a-9b6c2d9fd90b tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:08.259436 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-66017dcc-eaa6-4f42-802a-9b6c2d9fd90b tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.149873 Sep 14 01:09:08.260025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 255/488] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:08 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:09.114597 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-12aadc79-3049-407d-bfe9-2ec28d1f99c7 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:09.115210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-12aadc79-3049-407d-bfe9-2ec28d1f99c7 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:09.121713 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-12aadc79-3049-407d-bfe9-2ec28d1f99c7 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:09.122232 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-12aadc79-3049-407d-bfe9-2ec28d1f99c7 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:09.122678 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-12aadc79-3049-407d-bfe9-2ec28d1f99c7 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:09.123367 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-12aadc79-3049-407d-bfe9-2ec28d1f99c7 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:09.123859 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-12aadc79-3049-407d-bfe9-2ec28d1f99c7 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:09.124290 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-12aadc79-3049-407d-bfe9-2ec28d1f99c7 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:09.128375 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:09.187240 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-12aadc79-3049-407d-bfe9-2ec28d1f99c7 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:09.194798 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-12aadc79-3049-407d-bfe9-2ec28d1f99c7 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1271 microversion: 2.1 time: 0.084095 Sep 14 01:09:09.195357 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 234/489] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:09 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:09.282207 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1fda95dc-d8f1-4d5d-ac66-d740366de05f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:09.282819 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1fda95dc-d8f1-4d5d-ac66-d740366de05f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:09.289502 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1fda95dc-d8f1-4d5d-ac66-d740366de05f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:09.289981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1fda95dc-d8f1-4d5d-ac66-d740366de05f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:09.290415 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1fda95dc-d8f1-4d5d-ac66-d740366de05f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:09.291099 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1fda95dc-d8f1-4d5d-ac66-d740366de05f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:09.291573 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1fda95dc-d8f1-4d5d-ac66-d740366de05f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:09.292001 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1fda95dc-d8f1-4d5d-ac66-d740366de05f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:09.428024 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1fda95dc-d8f1-4d5d-ac66-d740366de05f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:09.435541 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1fda95dc-d8f1-4d5d-ac66-d740366de05f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.157212 Sep 14 01:09:09.436169 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 256/490] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:09 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:10.218121 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-59927330-f670-4b99-ab54-9f2ff7fb3d31 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:10.218735 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-59927330-f670-4b99-ab54-9f2ff7fb3d31 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:10.226003 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-59927330-f670-4b99-ab54-9f2ff7fb3d31 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:10.226491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-59927330-f670-4b99-ab54-9f2ff7fb3d31 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:10.226926 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-59927330-f670-4b99-ab54-9f2ff7fb3d31 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:10.227631 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-59927330-f670-4b99-ab54-9f2ff7fb3d31 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:10.228086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-59927330-f670-4b99-ab54-9f2ff7fb3d31 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:10.228504 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-59927330-f670-4b99-ab54-9f2ff7fb3d31 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:10.293414 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-59927330-f670-4b99-ab54-9f2ff7fb3d31 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:10.301734 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-59927330-f670-4b99-ab54-9f2ff7fb3d31 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1271 microversion: 2.1 time: 0.087477 Sep 14 01:09:10.302308 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 235/491] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:10 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:10.458775 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0d4780b9-3c21-4020-97fe-2b7b41095c0e tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:10.459385 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0d4780b9-3c21-4020-97fe-2b7b41095c0e tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:10.465310 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0d4780b9-3c21-4020-97fe-2b7b41095c0e tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:10.465788 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0d4780b9-3c21-4020-97fe-2b7b41095c0e tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:10.466216 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0d4780b9-3c21-4020-97fe-2b7b41095c0e tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:10.466901 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0d4780b9-3c21-4020-97fe-2b7b41095c0e tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:10.467380 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0d4780b9-3c21-4020-97fe-2b7b41095c0e tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:10.467830 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0d4780b9-3c21-4020-97fe-2b7b41095c0e tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:10.592499 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0d4780b9-3c21-4020-97fe-2b7b41095c0e tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:10.600601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0d4780b9-3c21-4020-97fe-2b7b41095c0e tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.146338 Sep 14 01:09:10.601157 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 257/492] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:10 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:11.324419 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2db3435a-d64e-4d22-8b78-ace4829da33c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:11.325106 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2db3435a-d64e-4d22-8b78-ace4829da33c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:11.332443 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2db3435a-d64e-4d22-8b78-ace4829da33c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:11.332886 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2db3435a-d64e-4d22-8b78-ace4829da33c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:11.333320 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2db3435a-d64e-4d22-8b78-ace4829da33c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:11.334013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2db3435a-d64e-4d22-8b78-ace4829da33c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:11.334462 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2db3435a-d64e-4d22-8b78-ace4829da33c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:11.334879 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2db3435a-d64e-4d22-8b78-ace4829da33c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:11.399569 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-2db3435a-d64e-4d22-8b78-ace4829da33c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:11.407054 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2db3435a-d64e-4d22-8b78-ace4829da33c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1271 microversion: 2.1 time: 0.086425 Sep 14 01:09:11.407643 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 236/493] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:11 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:11.473584 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-fb48a2dd-bbb0-4019-a80b-dbb64987ecca req-b9f208ff-9fd4-45a2-a1c9-a4501231e611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23077ed0-85ab-48fb-a533-9a0f035f29c8", "name": "network-vif-plugged", "status": "completed", "tag": "21627f84-f88e-4d81-bd53-27fd3579600b"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:09:11.483510 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-fb48a2dd-bbb0-4019-a80b-dbb64987ecca req-b9f208ff-9fd4-45a2-a1c9-a4501231e611 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:11.483728 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-fb48a2dd-bbb0-4019-a80b-dbb64987ecca req-b9f208ff-9fd4-45a2-a1c9-a4501231e611 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:11.484159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-fb48a2dd-bbb0-4019-a80b-dbb64987ecca req-b9f208ff-9fd4-45a2-a1c9-a4501231e611 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:11.495662 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-fb48a2dd-bbb0-4019-a80b-dbb64987ecca req-b9f208ff-9fd4-45a2-a1c9-a4501231e611 service nova] Creating event network-vif-plugged:21627f84-f88e-4d81-bd53-27fd3579600b for instance 23077ed0-85ab-48fb-a533-9a0f035f29c8 on hv-cinder-85752 Sep 14 01:09:11.500583 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-fb48a2dd-bbb0-4019-a80b-dbb64987ecca req-b9f208ff-9fd4-45a2-a1c9-a4501231e611 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031746 Sep 14 01:09:11.501171 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 258/494] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:09:11.622205 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6990355e-605e-438d-a1a6-8ff2dd615731 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:11.622814 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-6990355e-605e-438d-a1a6-8ff2dd615731 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:11.629205 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6990355e-605e-438d-a1a6-8ff2dd615731 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:11.629684 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6990355e-605e-438d-a1a6-8ff2dd615731 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:11.630116 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6990355e-605e-438d-a1a6-8ff2dd615731 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:11.630797 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6990355e-605e-438d-a1a6-8ff2dd615731 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:11.631252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6990355e-605e-438d-a1a6-8ff2dd615731 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:11.631707 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6990355e-605e-438d-a1a6-8ff2dd615731 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:11.769327 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6990355e-605e-438d-a1a6-8ff2dd615731 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:11.777566 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-6990355e-605e-438d-a1a6-8ff2dd615731 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.159175 Sep 14 01:09:11.779157 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 237/495] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:11 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:12.431511 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-463d86b0-923c-4b64-9110-45fea603910c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:12.432235 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-463d86b0-923c-4b64-9110-45fea603910c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:12.440864 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-463d86b0-923c-4b64-9110-45fea603910c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:12.441357 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-463d86b0-923c-4b64-9110-45fea603910c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:12.441991 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-463d86b0-923c-4b64-9110-45fea603910c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:12.443224 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-463d86b0-923c-4b64-9110-45fea603910c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:12.444535 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-463d86b0-923c-4b64-9110-45fea603910c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:12.445156 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-463d86b0-923c-4b64-9110-45fea603910c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:12.598002 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-463d86b0-923c-4b64-9110-45fea603910c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:12.605635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-463d86b0-923c-4b64-9110-45fea603910c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1319 microversion: 2.1 time: 0.178626 Sep 14 01:09:12.606193 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 259/496] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:12 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:12.727017 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0341f262-fcaa-4ead-b68e-63adcea191c3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:12.727520 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0341f262-fcaa-4ead-b68e-63adcea191c3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:12.733797 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0341f262-fcaa-4ead-b68e-63adcea191c3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:12.734278 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0341f262-fcaa-4ead-b68e-63adcea191c3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:12.734715 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0341f262-fcaa-4ead-b68e-63adcea191c3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:12.735399 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0341f262-fcaa-4ead-b68e-63adcea191c3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:12.735930 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0341f262-fcaa-4ead-b68e-63adcea191c3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:12.736355 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0341f262-fcaa-4ead-b68e-63adcea191c3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:12.760157 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0341f262-fcaa-4ead-b68e-63adcea191c3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a/ips" status: 200 len: 150 microversion: 2.1 time: 0.037094 Sep 14 01:09:12.760719 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 238/497] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Sep 14 01:09:12 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:09:12.801776 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6659cf8e-6348-442b-a1aa-77d653bcb9b3 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:12.802494 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6659cf8e-6348-442b-a1aa-77d653bcb9b3 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:12.808413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6659cf8e-6348-442b-a1aa-77d653bcb9b3 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:12.808919 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6659cf8e-6348-442b-a1aa-77d653bcb9b3 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:12.809355 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6659cf8e-6348-442b-a1aa-77d653bcb9b3 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:12.810037 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6659cf8e-6348-442b-a1aa-77d653bcb9b3 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:12.810489 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6659cf8e-6348-442b-a1aa-77d653bcb9b3 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:12.810912 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6659cf8e-6348-442b-a1aa-77d653bcb9b3 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:12.814991 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:12.947155 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6659cf8e-6348-442b-a1aa-77d653bcb9b3 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:12.955131 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6659cf8e-6348-442b-a1aa-77d653bcb9b3 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.157733 Sep 14 01:09:12.956065 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 260/498] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:12 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:13.628490 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ba870667-d778-4c55-9110-603671f0295f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:13.629122 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ba870667-d778-4c55-9110-603671f0295f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:13.635019 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba870667-d778-4c55-9110-603671f0295f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:13.635497 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba870667-d778-4c55-9110-603671f0295f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:13.635961 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba870667-d778-4c55-9110-603671f0295f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:13.636637 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba870667-d778-4c55-9110-603671f0295f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:13.637355 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba870667-d778-4c55-9110-603671f0295f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:13.637772 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba870667-d778-4c55-9110-603671f0295f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:13.765232 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ba870667-d778-4c55-9110-603671f0295f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:13.773693 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ba870667-d778-4c55-9110-603671f0295f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1319 microversion: 2.1 time: 0.149232 Sep 14 01:09:13.774251 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 239/499] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:13 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:13.961870 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-cdf18ec3-778d-4bca-bffc-e951ada9dbea tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:13.962432 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-cdf18ec3-778d-4bca-bffc-e951ada9dbea tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:13.968293 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cdf18ec3-778d-4bca-bffc-e951ada9dbea tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:13.968777 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cdf18ec3-778d-4bca-bffc-e951ada9dbea tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:13.969211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cdf18ec3-778d-4bca-bffc-e951ada9dbea tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:13.969898 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cdf18ec3-778d-4bca-bffc-e951ada9dbea tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:13.970422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cdf18ec3-778d-4bca-bffc-e951ada9dbea tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:13.970895 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cdf18ec3-778d-4bca-bffc-e951ada9dbea tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:13.978078 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-099590d4-b692-4225-95b0-44fad9887664 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:13.978677 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-099590d4-b692-4225-95b0-44fad9887664 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:13.984469 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-099590d4-b692-4225-95b0-44fad9887664 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:13.984974 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-099590d4-b692-4225-95b0-44fad9887664 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:13.985405 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-099590d4-b692-4225-95b0-44fad9887664 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:13.986194 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-099590d4-b692-4225-95b0-44fad9887664 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:13.986693 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-099590d4-b692-4225-95b0-44fad9887664 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:13.987063 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-099590d4-b692-4225-95b0-44fad9887664 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:13.994207 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-cdf18ec3-778d-4bca-bffc-e951ada9dbea tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9/ips" status: 200 len: 153 microversion: 2.20 time: 0.036276 Sep 14 01:09:13.994784 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 261/500] 10.222.0.42 () {60 vars in 1289 bytes} [Wed Sep 14 01:09:13 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9/ips => generated 153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 01:09:14.133706 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-099590d4-b692-4225-95b0-44fad9887664 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:14.141701 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-099590d4-b692-4225-95b0-44fad9887664 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.167428 Sep 14 01:09:14.142848 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 240/501] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:13 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:09:14.797045 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7b5da42d-1889-4e0f-9bae-639c98abef85 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:14.797659 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7b5da42d-1889-4e0f-9bae-639c98abef85 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:14.804499 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7b5da42d-1889-4e0f-9bae-639c98abef85 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:14.804920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7b5da42d-1889-4e0f-9bae-639c98abef85 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:14.805355 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7b5da42d-1889-4e0f-9bae-639c98abef85 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:14.806038 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7b5da42d-1889-4e0f-9bae-639c98abef85 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:14.806491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7b5da42d-1889-4e0f-9bae-639c98abef85 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:14.806916 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7b5da42d-1889-4e0f-9bae-639c98abef85 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:14.932677 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7b5da42d-1889-4e0f-9bae-639c98abef85 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:14.940364 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7b5da42d-1889-4e0f-9bae-639c98abef85 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1319 microversion: 2.1 time: 0.147180 Sep 14 01:09:14.940925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 262/502] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:14 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:15.166716 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-5d350b99-4a77-460f-ad50-ae17bf54ece5 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:15.167416 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-5d350b99-4a77-460f-ad50-ae17bf54ece5 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:15.174280 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5d350b99-4a77-460f-ad50-ae17bf54ece5 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:15.174763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5d350b99-4a77-460f-ad50-ae17bf54ece5 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:15.175226 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5d350b99-4a77-460f-ad50-ae17bf54ece5 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:15.175969 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5d350b99-4a77-460f-ad50-ae17bf54ece5 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:15.176544 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5d350b99-4a77-460f-ad50-ae17bf54ece5 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:15.176977 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5d350b99-4a77-460f-ad50-ae17bf54ece5 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:15.308238 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-5d350b99-4a77-460f-ad50-ae17bf54ece5 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:15.317023 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-5d350b99-4a77-460f-ad50-ae17bf54ece5 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.154124 Sep 14 01:09:15.317580 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 241/503] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:15 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:15.964686 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-86cc61b7-e450-4ff6-9132-7cb73faa1314 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:15.965293 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-86cc61b7-e450-4ff6-9132-7cb73faa1314 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:15.971258 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-86cc61b7-e450-4ff6-9132-7cb73faa1314 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:15.971782 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-86cc61b7-e450-4ff6-9132-7cb73faa1314 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:15.972220 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-86cc61b7-e450-4ff6-9132-7cb73faa1314 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:15.972914 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-86cc61b7-e450-4ff6-9132-7cb73faa1314 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:15.973369 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-86cc61b7-e450-4ff6-9132-7cb73faa1314 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:15.973794 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-86cc61b7-e450-4ff6-9132-7cb73faa1314 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:16.102315 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-86cc61b7-e450-4ff6-9132-7cb73faa1314 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:16.109881 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-86cc61b7-e450-4ff6-9132-7cb73faa1314 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1319 microversion: 2.1 time: 0.150000 Sep 14 01:09:16.110453 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 263/504] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:15 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:16.216075 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-b8effbfb-7c72-4918-98e2-2dda01535cb6 req-ca2122c8-0d86-4c03-b00f-5a804e66c5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41efe3bb-948d-49f2-974e-c1d3b846b8a8", "tag": "775a97ae-c50c-4753-9069-80eb4c6633cf"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:09:16.227231 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-b8effbfb-7c72-4918-98e2-2dda01535cb6 req-ca2122c8-0d86-4c03-b00f-5a804e66c5c3 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:16.227836 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-b8effbfb-7c72-4918-98e2-2dda01535cb6 req-ca2122c8-0d86-4c03-b00f-5a804e66c5c3 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:16.228336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-b8effbfb-7c72-4918-98e2-2dda01535cb6 req-ca2122c8-0d86-4c03-b00f-5a804e66c5c3 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:16.240699 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-b8effbfb-7c72-4918-98e2-2dda01535cb6 req-ca2122c8-0d86-4c03-b00f-5a804e66c5c3 service nova] Creating event network-changed:775a97ae-c50c-4753-9069-80eb4c6633cf for instance 41efe3bb-948d-49f2-974e-c1d3b846b8a8 on hv-cinder-85752 Sep 14 01:09:16.245615 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-b8effbfb-7c72-4918-98e2-2dda01535cb6 req-ca2122c8-0d86-4c03-b00f-5a804e66c5c3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034762 Sep 14 01:09:16.246308 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 242/505] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:09:16.340649 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-52ae7d44-47a4-491b-b5ee-180e66769508 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:16.341260 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-52ae7d44-47a4-491b-b5ee-180e66769508 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:16.348145 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52ae7d44-47a4-491b-b5ee-180e66769508 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:16.348629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52ae7d44-47a4-491b-b5ee-180e66769508 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:16.349066 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52ae7d44-47a4-491b-b5ee-180e66769508 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:16.349751 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52ae7d44-47a4-491b-b5ee-180e66769508 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:16.350205 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52ae7d44-47a4-491b-b5ee-180e66769508 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:16.350632 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52ae7d44-47a4-491b-b5ee-180e66769508 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:16.481664 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-52ae7d44-47a4-491b-b5ee-180e66769508 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:16.489930 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-52ae7d44-47a4-491b-b5ee-180e66769508 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.152942 Sep 14 01:09:16.490681 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 264/506] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:16 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:17.130678 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=2 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:17.134967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9a5120f4-3f1e-4870-8ab7-6df1a96386b8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:17.135723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9a5120f4-3f1e-4870-8ab7-6df1a96386b8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:17.137896 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:17.144859 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9a5120f4-3f1e-4870-8ab7-6df1a96386b8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:17.145344 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9a5120f4-3f1e-4870-8ab7-6df1a96386b8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:17.145784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9a5120f4-3f1e-4870-8ab7-6df1a96386b8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:17.146471 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9a5120f4-3f1e-4870-8ab7-6df1a96386b8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:17.146926 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9a5120f4-3f1e-4870-8ab7-6df1a96386b8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:17.147352 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9a5120f4-3f1e-4870-8ab7-6df1a96386b8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:17.279724 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9a5120f4-3f1e-4870-8ab7-6df1a96386b8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:17.289021 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9a5120f4-3f1e-4870-8ab7-6df1a96386b8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1319 microversion: 2.1 time: 0.159139 Sep 14 01:09:17.289526 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 243/507] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:17 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:17.455433 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d1c2173d-8944-41f5-bc1a-9f5557267a5d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:17.456173 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d1c2173d-8944-41f5-bc1a-9f5557267a5d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:17.457901 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:17.458738 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=6 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:17.459518 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:17.464144 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d1c2173d-8944-41f5-bc1a-9f5557267a5d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:17.464635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d1c2173d-8944-41f5-bc1a-9f5557267a5d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:17.465278 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d1c2173d-8944-41f5-bc1a-9f5557267a5d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:17.465977 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d1c2173d-8944-41f5-bc1a-9f5557267a5d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:17.466470 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d1c2173d-8944-41f5-bc1a-9f5557267a5d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:17.466901 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d1c2173d-8944-41f5-bc1a-9f5557267a5d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:17.494489 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d1c2173d-8944-41f5-bc1a-9f5557267a5d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32/ips" status: 200 len: 144 microversion: 2.1 time: 0.043397 Sep 14 01:09:17.495052 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 265/508] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Sep 14 01:09:17 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32/ips => generated 144 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:09:17.513462 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-1c5d3749-7e4c-4f39-9203-64f7fb6191d3 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:17.514112 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-1c5d3749-7e4c-4f39-9203-64f7fb6191d3 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:17.520881 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1c5d3749-7e4c-4f39-9203-64f7fb6191d3 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:17.521354 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1c5d3749-7e4c-4f39-9203-64f7fb6191d3 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:17.521782 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1c5d3749-7e4c-4f39-9203-64f7fb6191d3 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:17.522459 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1c5d3749-7e4c-4f39-9203-64f7fb6191d3 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:17.522907 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1c5d3749-7e4c-4f39-9203-64f7fb6191d3 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:17.523326 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1c5d3749-7e4c-4f39-9203-64f7fb6191d3 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:17.655482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-1c5d3749-7e4c-4f39-9203-64f7fb6191d3 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:17.663506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-1c5d3749-7e4c-4f39-9203-64f7fb6191d3 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.154115 Sep 14 01:09:17.664080 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 244/509] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:17 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:18.314456 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-524e1afc-4c15-4830-ab18-e226b55866d0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:18.315183 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-524e1afc-4c15-4830-ab18-e226b55866d0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:18.321524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-524e1afc-4c15-4830-ab18-e226b55866d0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:18.322196 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-524e1afc-4c15-4830-ab18-e226b55866d0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:18.322788 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-524e1afc-4c15-4830-ab18-e226b55866d0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:18.323765 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-524e1afc-4c15-4830-ab18-e226b55866d0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:18.324311 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-524e1afc-4c15-4830-ab18-e226b55866d0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:18.324885 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-524e1afc-4c15-4830-ab18-e226b55866d0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:18.464416 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-524e1afc-4c15-4830-ab18-e226b55866d0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:18.483757 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-524e1afc-4c15-4830-ab18-e226b55866d0 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1319 microversion: 2.1 time: 0.173729 Sep 14 01:09:18.495339 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 266/510] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:18 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:18.686618 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-17fe8722-ddda-4c73-b663-626e0163a83a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:18.687471 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-17fe8722-ddda-4c73-b663-626e0163a83a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:18.694681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17fe8722-ddda-4c73-b663-626e0163a83a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:18.695348 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17fe8722-ddda-4c73-b663-626e0163a83a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:18.695910 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17fe8722-ddda-4c73-b663-626e0163a83a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:18.696668 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17fe8722-ddda-4c73-b663-626e0163a83a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:18.697551 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17fe8722-ddda-4c73-b663-626e0163a83a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:18.698104 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17fe8722-ddda-4c73-b663-626e0163a83a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:18.905757 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-17fe8722-ddda-4c73-b663-626e0163a83a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:18.913999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-17fe8722-ddda-4c73-b663-626e0163a83a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1315 microversion: 2.1 time: 0.231374 Sep 14 01:09:18.914572 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 245/511] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:18 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:19.421855 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1ceea0b4-0188-42b7-9a98-d598d3b0f37b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ad2c6bf-fcdd-46fb-8adc-6122188ced6b"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:09:19.424933 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1ceea0b4-0188-42b7-9a98-d598d3b0f37b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:19.430843 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1ceea0b4-0188-42b7-9a98-d598d3b0f37b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:19.431328 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1ceea0b4-0188-42b7-9a98-d598d3b0f37b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:19.431795 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1ceea0b4-0188-42b7-9a98-d598d3b0f37b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:19.432485 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1ceea0b4-0188-42b7-9a98-d598d3b0f37b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:19.432941 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1ceea0b4-0188-42b7-9a98-d598d3b0f37b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:19.433372 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1ceea0b4-0188-42b7-9a98-d598d3b0f37b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:19.507020 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4790fdcd-ca76-4d2e-93e2-a11c2b50baae tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:19.507777 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4790fdcd-ca76-4d2e-93e2-a11c2b50baae tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:19.514033 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4790fdcd-ca76-4d2e-93e2-a11c2b50baae tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:19.514612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4790fdcd-ca76-4d2e-93e2-a11c2b50baae tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:19.515107 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4790fdcd-ca76-4d2e-93e2-a11c2b50baae tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:19.515900 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4790fdcd-ca76-4d2e-93e2-a11c2b50baae tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:19.516488 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4790fdcd-ca76-4d2e-93e2-a11c2b50baae tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:19.517041 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4790fdcd-ca76-4d2e-93e2-a11c2b50baae tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:19.653568 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4790fdcd-ca76-4d2e-93e2-a11c2b50baae tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:19.661695 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4790fdcd-ca76-4d2e-93e2-a11c2b50baae tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1319 microversion: 2.1 time: 0.158583 Sep 14 01:09:19.662250 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 246/512] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:19 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:19.904531 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1ceea0b4-0188-42b7-9a98-d598d3b0f37b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "POST /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.486343 Sep 14 01:09:19.905310 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 267/513] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 01:09:19 2022] POST /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a/os-volume_attachments => generated 194 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:09:19.937068 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e88931aa-7a23-42b0-a754-2ab4289964f0 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:19.937662 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-e88931aa-7a23-42b0-a754-2ab4289964f0 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:19.944811 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e88931aa-7a23-42b0-a754-2ab4289964f0 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:19.945299 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e88931aa-7a23-42b0-a754-2ab4289964f0 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:19.945723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e88931aa-7a23-42b0-a754-2ab4289964f0 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:19.946588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e88931aa-7a23-42b0-a754-2ab4289964f0 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:19.947032 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e88931aa-7a23-42b0-a754-2ab4289964f0 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:19.947636 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e88931aa-7a23-42b0-a754-2ab4289964f0 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:20.163830 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e88931aa-7a23-42b0-a754-2ab4289964f0 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:20.172962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-e88931aa-7a23-42b0-a754-2ab4289964f0 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1464 microversion: 2.1 time: 0.240081 Sep 14 01:09:20.174464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 247/514] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:19 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1464 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:20.222377 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1aebf1f1-1d05-4b89-a375-901fe580ed98 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:20.222956 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1aebf1f1-1d05-4b89-a375-901fe580ed98 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:20.229208 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1aebf1f1-1d05-4b89-a375-901fe580ed98 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:20.229691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1aebf1f1-1d05-4b89-a375-901fe580ed98 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:20.230126 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1aebf1f1-1d05-4b89-a375-901fe580ed98 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:20.230811 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1aebf1f1-1d05-4b89-a375-901fe580ed98 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:20.231266 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1aebf1f1-1d05-4b89-a375-901fe580ed98 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:20.231723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1aebf1f1-1d05-4b89-a375-901fe580ed98 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:20.257755 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1aebf1f1-1d05-4b89-a375-901fe580ed98 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Going to try to terminate instance {{(pid=120621) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:09:20.330700 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1aebf1f1-1d05-4b89-a375-901fe580ed98 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "DELETE /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 204 len: 0 microversion: 2.1 time: 0.112743 Sep 14 01:09:20.331209 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 268/515] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:09:20 2022] DELETE /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 01:09:20.339168 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-cc7c1790-aba4-4ec5-8e65-eef7b6a9a96e tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:20.339882 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-cc7c1790-aba4-4ec5-8e65-eef7b6a9a96e tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:20.345974 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cc7c1790-aba4-4ec5-8e65-eef7b6a9a96e tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:20.346457 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cc7c1790-aba4-4ec5-8e65-eef7b6a9a96e tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:20.346888 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cc7c1790-aba4-4ec5-8e65-eef7b6a9a96e tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:20.347582 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cc7c1790-aba4-4ec5-8e65-eef7b6a9a96e tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:20.348037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cc7c1790-aba4-4ec5-8e65-eef7b6a9a96e tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:20.348453 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cc7c1790-aba4-4ec5-8e65-eef7b6a9a96e tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:20.476846 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-cc7c1790-aba4-4ec5-8e65-eef7b6a9a96e tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:20.484706 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-cc7c1790-aba4-4ec5-8e65-eef7b6a9a96e tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1470 microversion: 2.1 time: 0.149187 Sep 14 01:09:20.485302 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 248/516] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:20 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:20.647907 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-00b498e0-895a-4be8-8017-e355c66f577b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90afba07-ba11-495e-9daf-e9598cf17356"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:09:20.650387 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-00b498e0-895a-4be8-8017-e355c66f577b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:20.657019 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-00b498e0-895a-4be8-8017-e355c66f577b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:20.658454 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-00b498e0-895a-4be8-8017-e355c66f577b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:20.658900 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-00b498e0-895a-4be8-8017-e355c66f577b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:20.659620 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-00b498e0-895a-4be8-8017-e355c66f577b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:20.660084 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-00b498e0-895a-4be8-8017-e355c66f577b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:20.660511 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-00b498e0-895a-4be8-8017-e355c66f577b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:20.686275 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2395b3d2-f747-41dc-a0f2-7aa0674e1176 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:20.686890 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2395b3d2-f747-41dc-a0f2-7aa0674e1176 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:20.693673 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2395b3d2-f747-41dc-a0f2-7aa0674e1176 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:20.694195 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2395b3d2-f747-41dc-a0f2-7aa0674e1176 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:20.694806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2395b3d2-f747-41dc-a0f2-7aa0674e1176 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:20.695695 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2395b3d2-f747-41dc-a0f2-7aa0674e1176 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:20.696149 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2395b3d2-f747-41dc-a0f2-7aa0674e1176 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:20.696733 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2395b3d2-f747-41dc-a0f2-7aa0674e1176 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:20.833949 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-2395b3d2-f747-41dc-a0f2-7aa0674e1176 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:20.841669 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2395b3d2-f747-41dc-a0f2-7aa0674e1176 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1319 microversion: 2.1 time: 0.159579 Sep 14 01:09:20.842168 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 249/517] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:20 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:21.212952 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-fa69fb1e-ba6a-4d09-bb64-453be0c21239 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:09:21.213621 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-fa69fb1e-ba6a-4d09-bb64-453be0c21239 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:21.219760 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa69fb1e-ba6a-4d09-bb64-453be0c21239 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:21.220984 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa69fb1e-ba6a-4d09-bb64-453be0c21239 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:21.221424 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa69fb1e-ba6a-4d09-bb64-453be0c21239 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:21.222177 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa69fb1e-ba6a-4d09-bb64-453be0c21239 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:21.222635 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa69fb1e-ba6a-4d09-bb64-453be0c21239 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:21.223055 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa69fb1e-ba6a-4d09-bb64-453be0c21239 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:21.245257 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-fa69fb1e-ba6a-4d09-bb64-453be0c21239 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lazy-loading 'flavor' on Instance uuid d02da4a4-64f7-47c0-a48f-9cdb71f30df9 {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:09:21.320521 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:21.472964 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-fa69fb1e-ba6a-4d09-bb64-453be0c21239 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "POST /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9/action" status: 202 len: 0 microversion: 2.20 time: 0.263700 Sep 14 01:09:21.473486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 250/518] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Sep 14 01:09:21 2022] POST /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 14 01:09:21.481855 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9bfa5f63-2f89-439b-aba8-21d38f4e60c6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:21.482541 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9bfa5f63-2f89-439b-aba8-21d38f4e60c6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:21.490036 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9bfa5f63-2f89-439b-aba8-21d38f4e60c6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:21.490514 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9bfa5f63-2f89-439b-aba8-21d38f4e60c6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:21.490944 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9bfa5f63-2f89-439b-aba8-21d38f4e60c6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:21.491648 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9bfa5f63-2f89-439b-aba8-21d38f4e60c6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:21.492099 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9bfa5f63-2f89-439b-aba8-21d38f4e60c6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:21.492517 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9bfa5f63-2f89-439b-aba8-21d38f4e60c6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:21.629017 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9bfa5f63-2f89-439b-aba8-21d38f4e60c6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:21.637268 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9bfa5f63-2f89-439b-aba8-21d38f4e60c6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:21.638709 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9bfa5f63-2f89-439b-aba8-21d38f4e60c6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:21.639883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9bfa5f63-2f89-439b-aba8-21d38f4e60c6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.162038 Sep 14 01:09:21.640432 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 251/519] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:21 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:09:21.646530 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d3d0e74b-454d-465b-b057-aa8d92e82691 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:21.647139 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d3d0e74b-454d-465b-b057-aa8d92e82691 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:21.652996 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d3d0e74b-454d-465b-b057-aa8d92e82691 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:21.653484 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d3d0e74b-454d-465b-b057-aa8d92e82691 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:21.653926 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d3d0e74b-454d-465b-b057-aa8d92e82691 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:21.654695 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d3d0e74b-454d-465b-b057-aa8d92e82691 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:21.655149 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d3d0e74b-454d-465b-b057-aa8d92e82691 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:21.655623 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d3d0e74b-454d-465b-b057-aa8d92e82691 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:21.785741 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d3d0e74b-454d-465b-b057-aa8d92e82691 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:21.793304 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d3d0e74b-454d-465b-b057-aa8d92e82691 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1470 microversion: 2.1 time: 0.151209 Sep 14 01:09:21.793867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 252/520] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:21 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:21.865675 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-bbfb59c2-c4bd-433b-8397-18d3539d8b90 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:21.866279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-bbfb59c2-c4bd-433b-8397-18d3539d8b90 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:21.872068 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bbfb59c2-c4bd-433b-8397-18d3539d8b90 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:21.872546 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bbfb59c2-c4bd-433b-8397-18d3539d8b90 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:21.872974 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bbfb59c2-c4bd-433b-8397-18d3539d8b90 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:21.873654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bbfb59c2-c4bd-433b-8397-18d3539d8b90 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:21.874099 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bbfb59c2-c4bd-433b-8397-18d3539d8b90 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:21.874516 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bbfb59c2-c4bd-433b-8397-18d3539d8b90 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:22.006045 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bbfb59c2-c4bd-433b-8397-18d3539d8b90 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:22.014506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-bbfb59c2-c4bd-433b-8397-18d3539d8b90 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1319 microversion: 2.1 time: 0.152617 Sep 14 01:09:22.015067 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 253/521] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:21 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:09:22.667104 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-5d36ce25-e6fc-4b48-8fe2-f0c307c6be07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:22.667742 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-5d36ce25-e6fc-4b48-8fe2-f0c307c6be07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:22.674755 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5d36ce25-e6fc-4b48-8fe2-f0c307c6be07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:22.675241 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5d36ce25-e6fc-4b48-8fe2-f0c307c6be07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:22.675843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5d36ce25-e6fc-4b48-8fe2-f0c307c6be07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:22.676535 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5d36ce25-e6fc-4b48-8fe2-f0c307c6be07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:22.676990 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5d36ce25-e6fc-4b48-8fe2-f0c307c6be07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:22.677414 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5d36ce25-e6fc-4b48-8fe2-f0c307c6be07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:22.810913 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-5d36ce25-e6fc-4b48-8fe2-f0c307c6be07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:22.819301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-5d36ce25-e6fc-4b48-8fe2-f0c307c6be07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:22.820832 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-5d36ce25-e6fc-4b48-8fe2-f0c307c6be07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:22.822003 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-5d36ce25-e6fc-4b48-8fe2-f0c307c6be07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.158762 Sep 14 01:09:22.822549 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 254/522] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:22 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:09:22.826931 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-50981f76-768a-491b-92a0-09c7e96e779a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:22.827523 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-50981f76-768a-491b-92a0-09c7e96e779a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:22.832906 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-50981f76-768a-491b-92a0-09c7e96e779a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:22.833388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-50981f76-768a-491b-92a0-09c7e96e779a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:22.833821 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-50981f76-768a-491b-92a0-09c7e96e779a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:22.834500 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-50981f76-768a-491b-92a0-09c7e96e779a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:22.834947 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-50981f76-768a-491b-92a0-09c7e96e779a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:22.835366 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-50981f76-768a-491b-92a0-09c7e96e779a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:22.958966 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-50981f76-768a-491b-92a0-09c7e96e779a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:22.966689 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-50981f76-768a-491b-92a0-09c7e96e779a tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1470 microversion: 2.1 time: 0.143154 Sep 14 01:09:22.967251 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 255/523] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:22 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1470 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:23.037157 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-cfde4582-bac8-4267-9dea-18bab7a0686f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:23.037766 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-cfde4582-bac8-4267-9dea-18bab7a0686f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:23.043763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cfde4582-bac8-4267-9dea-18bab7a0686f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:23.044250 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cfde4582-bac8-4267-9dea-18bab7a0686f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:23.044688 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cfde4582-bac8-4267-9dea-18bab7a0686f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:23.045382 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cfde4582-bac8-4267-9dea-18bab7a0686f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:23.045841 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cfde4582-bac8-4267-9dea-18bab7a0686f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:23.046285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cfde4582-bac8-4267-9dea-18bab7a0686f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:23.176615 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-cfde4582-bac8-4267-9dea-18bab7a0686f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:23.184193 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-cfde4582-bac8-4267-9dea-18bab7a0686f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1319 microversion: 2.1 time: 0.150656 Sep 14 01:09:23.184764 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 256/524] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:23 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:09:23.847006 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-c75d2bf3-f972-4482-a707-7290085ade40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:23.847740 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-c75d2bf3-f972-4482-a707-7290085ade40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:23.854289 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c75d2bf3-f972-4482-a707-7290085ade40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:23.854777 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c75d2bf3-f972-4482-a707-7290085ade40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:23.855207 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c75d2bf3-f972-4482-a707-7290085ade40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:23.855918 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c75d2bf3-f972-4482-a707-7290085ade40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:23.856370 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c75d2bf3-f972-4482-a707-7290085ade40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:23.856786 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c75d2bf3-f972-4482-a707-7290085ade40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:23.983050 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c75d2bf3-f972-4482-a707-7290085ade40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:23.991983 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c75d2bf3-f972-4482-a707-7290085ade40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:23.993430 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c75d2bf3-f972-4482-a707-7290085ade40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:23.994573 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-c75d2bf3-f972-4482-a707-7290085ade40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.151527 Sep 14 01:09:23.995127 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 257/525] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:23 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:09:23.999481 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8e26d2d7-384d-4504-b81a-5d95cb224b22 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:24.000113 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8e26d2d7-384d-4504-b81a-5d95cb224b22 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:24.006346 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8e26d2d7-384d-4504-b81a-5d95cb224b22 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:24.006831 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8e26d2d7-384d-4504-b81a-5d95cb224b22 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:24.007267 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8e26d2d7-384d-4504-b81a-5d95cb224b22 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:24.007980 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8e26d2d7-384d-4504-b81a-5d95cb224b22 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:24.008436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8e26d2d7-384d-4504-b81a-5d95cb224b22 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:24.008857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8e26d2d7-384d-4504-b81a-5d95cb224b22 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:24.137955 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8e26d2d7-384d-4504-b81a-5d95cb224b22 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:24.146561 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8e26d2d7-384d-4504-b81a-5d95cb224b22 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1470 microversion: 2.1 time: 0.150446 Sep 14 01:09:24.147126 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 258/526] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:23 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:24.206094 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8d8a829a-e86b-4b08-8218-cc0b3fdf315f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:24.206706 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8d8a829a-e86b-4b08-8218-cc0b3fdf315f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:24.212671 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d8a829a-e86b-4b08-8218-cc0b3fdf315f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:24.213162 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d8a829a-e86b-4b08-8218-cc0b3fdf315f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:24.213596 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d8a829a-e86b-4b08-8218-cc0b3fdf315f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:24.214290 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d8a829a-e86b-4b08-8218-cc0b3fdf315f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:24.214747 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d8a829a-e86b-4b08-8218-cc0b3fdf315f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:24.215172 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d8a829a-e86b-4b08-8218-cc0b3fdf315f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:24.342758 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8d8a829a-e86b-4b08-8218-cc0b3fdf315f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:24.351202 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8d8a829a-e86b-4b08-8218-cc0b3fdf315f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1319 microversion: 2.1 time: 0.148848 Sep 14 01:09:24.351864 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 259/527] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:24 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:09:25.020748 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-05e2f6e1-87fa-4982-a9a5-336e4a693a53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:25.021399 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-05e2f6e1-87fa-4982-a9a5-336e4a693a53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:25.027768 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-05e2f6e1-87fa-4982-a9a5-336e4a693a53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:25.028257 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-05e2f6e1-87fa-4982-a9a5-336e4a693a53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:25.028695 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-05e2f6e1-87fa-4982-a9a5-336e4a693a53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:25.029379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-05e2f6e1-87fa-4982-a9a5-336e4a693a53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:25.029829 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-05e2f6e1-87fa-4982-a9a5-336e4a693a53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:25.030249 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-05e2f6e1-87fa-4982-a9a5-336e4a693a53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:25.161720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-05e2f6e1-87fa-4982-a9a5-336e4a693a53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:25.169829 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-05e2f6e1-87fa-4982-a9a5-336e4a693a53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:25.171326 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-05e2f6e1-87fa-4982-a9a5-336e4a693a53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:25.172517 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-05e2f6e1-87fa-4982-a9a5-336e4a693a53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.155804 Sep 14 01:09:25.173077 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 260/528] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:25 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:09:25.178242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-458abe7b-a5ba-4eb0-92c9-681511fc5de2 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:25.178843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-458abe7b-a5ba-4eb0-92c9-681511fc5de2 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:25.184419 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-458abe7b-a5ba-4eb0-92c9-681511fc5de2 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:25.184906 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-458abe7b-a5ba-4eb0-92c9-681511fc5de2 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:25.185342 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-458abe7b-a5ba-4eb0-92c9-681511fc5de2 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:25.186033 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-458abe7b-a5ba-4eb0-92c9-681511fc5de2 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:25.186488 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-458abe7b-a5ba-4eb0-92c9-681511fc5de2 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:25.186914 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-458abe7b-a5ba-4eb0-92c9-681511fc5de2 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:25.316772 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-458abe7b-a5ba-4eb0-92c9-681511fc5de2 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:25.324676 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-458abe7b-a5ba-4eb0-92c9-681511fc5de2 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1470 microversion: 2.1 time: 0.150588 Sep 14 01:09:25.325240 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 261/529] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:25 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:25.374222 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ed936e5d-eaa4-45b5-b6fa-8a506b574239 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:25.374824 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ed936e5d-eaa4-45b5-b6fa-8a506b574239 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:25.380716 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ed936e5d-eaa4-45b5-b6fa-8a506b574239 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:25.381202 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ed936e5d-eaa4-45b5-b6fa-8a506b574239 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:25.381644 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ed936e5d-eaa4-45b5-b6fa-8a506b574239 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:25.382327 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ed936e5d-eaa4-45b5-b6fa-8a506b574239 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:25.382784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ed936e5d-eaa4-45b5-b6fa-8a506b574239 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:25.383208 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ed936e5d-eaa4-45b5-b6fa-8a506b574239 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:25.509292 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ed936e5d-eaa4-45b5-b6fa-8a506b574239 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:25.517115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ed936e5d-eaa4-45b5-b6fa-8a506b574239 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1319 microversion: 2.1 time: 0.146517 Sep 14 01:09:25.517672 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 262/530] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:25 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:09:26.197869 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-47a433fa-7284-46cd-8096-7a13e21bd99d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:26.198799 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-47a433fa-7284-46cd-8096-7a13e21bd99d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:26.205366 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-47a433fa-7284-46cd-8096-7a13e21bd99d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:26.205846 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-47a433fa-7284-46cd-8096-7a13e21bd99d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:26.206278 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-47a433fa-7284-46cd-8096-7a13e21bd99d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:26.206989 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-47a433fa-7284-46cd-8096-7a13e21bd99d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:26.207576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-47a433fa-7284-46cd-8096-7a13e21bd99d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:26.208022 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-47a433fa-7284-46cd-8096-7a13e21bd99d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:26.338644 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-47a433fa-7284-46cd-8096-7a13e21bd99d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:26.347029 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-47a433fa-7284-46cd-8096-7a13e21bd99d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:26.348503 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-47a433fa-7284-46cd-8096-7a13e21bd99d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:26.349640 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-47a433fa-7284-46cd-8096-7a13e21bd99d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.155671 Sep 14 01:09:26.350187 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 263/531] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:26 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:09:26.354778 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4fe1a773-1fbd-4c89-a9e9-5ba966f3ef92 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:26.355375 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4fe1a773-1fbd-4c89-a9e9-5ba966f3ef92 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:26.360914 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4fe1a773-1fbd-4c89-a9e9-5ba966f3ef92 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:26.361391 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4fe1a773-1fbd-4c89-a9e9-5ba966f3ef92 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:26.361821 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4fe1a773-1fbd-4c89-a9e9-5ba966f3ef92 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:26.362500 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4fe1a773-1fbd-4c89-a9e9-5ba966f3ef92 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:26.362950 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4fe1a773-1fbd-4c89-a9e9-5ba966f3ef92 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:26.363887 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4fe1a773-1fbd-4c89-a9e9-5ba966f3ef92 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:26.491171 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4fe1a773-1fbd-4c89-a9e9-5ba966f3ef92 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:26.498703 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4fe1a773-1fbd-4c89-a9e9-5ba966f3ef92 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1470 microversion: 2.1 time: 0.147540 Sep 14 01:09:26.499258 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 264/532] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:26 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:26.539571 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4aea82c7-a050-406e-9e1a-9e5b379c0cb3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:26.540184 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4aea82c7-a050-406e-9e1a-9e5b379c0cb3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:26.545847 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4aea82c7-a050-406e-9e1a-9e5b379c0cb3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:26.546328 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4aea82c7-a050-406e-9e1a-9e5b379c0cb3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:26.546765 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4aea82c7-a050-406e-9e1a-9e5b379c0cb3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:26.547455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4aea82c7-a050-406e-9e1a-9e5b379c0cb3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:26.547943 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4aea82c7-a050-406e-9e1a-9e5b379c0cb3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:26.548365 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4aea82c7-a050-406e-9e1a-9e5b379c0cb3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:26.677587 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4aea82c7-a050-406e-9e1a-9e5b379c0cb3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:26.685511 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4aea82c7-a050-406e-9e1a-9e5b379c0cb3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1319 microversion: 2.1 time: 0.149514 Sep 14 01:09:26.686115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 265/533] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:26 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:27.374670 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-1efcf2be-b535-42e2-b983-eaf42bffc11e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:27.375373 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-1efcf2be-b535-42e2-b983-eaf42bffc11e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:27.382196 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1efcf2be-b535-42e2-b983-eaf42bffc11e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:27.382673 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1efcf2be-b535-42e2-b983-eaf42bffc11e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:27.383104 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1efcf2be-b535-42e2-b983-eaf42bffc11e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:27.383806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1efcf2be-b535-42e2-b983-eaf42bffc11e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:27.384363 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1efcf2be-b535-42e2-b983-eaf42bffc11e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:27.384657 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1efcf2be-b535-42e2-b983-eaf42bffc11e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:27.404317 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:27.516565 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-1efcf2be-b535-42e2-b983-eaf42bffc11e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:27.525111 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-1efcf2be-b535-42e2-b983-eaf42bffc11e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:27.526540 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-1efcf2be-b535-42e2-b983-eaf42bffc11e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:27.527705 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-1efcf2be-b535-42e2-b983-eaf42bffc11e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.156893 Sep 14 01:09:27.528260 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 266/534] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:27 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:09:27.532802 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-23c5835a-c29f-4243-bb30-b21ad099057b tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:27.533388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-23c5835a-c29f-4243-bb30-b21ad099057b tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:27.539359 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-23c5835a-c29f-4243-bb30-b21ad099057b tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:27.539864 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-23c5835a-c29f-4243-bb30-b21ad099057b tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:27.540298 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-23c5835a-c29f-4243-bb30-b21ad099057b tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:27.540976 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-23c5835a-c29f-4243-bb30-b21ad099057b tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:27.541426 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-23c5835a-c29f-4243-bb30-b21ad099057b tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:27.541845 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-23c5835a-c29f-4243-bb30-b21ad099057b tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:27.684525 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-23c5835a-c29f-4243-bb30-b21ad099057b tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:27.693129 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-23c5835a-c29f-4243-bb30-b21ad099057b tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1470 microversion: 2.1 time: 0.163646 Sep 14 01:09:27.693703 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 267/535] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:27 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:27.709142 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-858ff6e2-1a1e-404e-877a-53d87026998e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:27.709929 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-858ff6e2-1a1e-404e-877a-53d87026998e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:27.716208 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-858ff6e2-1a1e-404e-877a-53d87026998e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:27.716685 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-858ff6e2-1a1e-404e-877a-53d87026998e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:27.717112 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-858ff6e2-1a1e-404e-877a-53d87026998e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:27.717797 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-858ff6e2-1a1e-404e-877a-53d87026998e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:27.718244 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-858ff6e2-1a1e-404e-877a-53d87026998e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:27.718661 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-858ff6e2-1a1e-404e-877a-53d87026998e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:27.857163 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-858ff6e2-1a1e-404e-877a-53d87026998e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:27.866315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-858ff6e2-1a1e-404e-877a-53d87026998e tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1319 microversion: 2.1 time: 0.161284 Sep 14 01:09:27.866894 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 268/536] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:27 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:09:28.068903 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-00b498e0-895a-4be8-8017-e355c66f577b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "POST /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.425725 Sep 14 01:09:28.069574 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 269/537] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 01:09:20 2022] POST /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32/os-volume_attachments => generated 194 bytes in 7428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:09:28.554494 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7aed7377-38a8-43b3-9d7d-cd1816a17aca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:28.555096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7aed7377-38a8-43b3-9d7d-cd1816a17aca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:28.561946 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7aed7377-38a8-43b3-9d7d-cd1816a17aca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:28.562462 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7aed7377-38a8-43b3-9d7d-cd1816a17aca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:28.562895 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7aed7377-38a8-43b3-9d7d-cd1816a17aca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:28.563816 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7aed7377-38a8-43b3-9d7d-cd1816a17aca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:28.564577 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7aed7377-38a8-43b3-9d7d-cd1816a17aca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:28.565258 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7aed7377-38a8-43b3-9d7d-cd1816a17aca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:28.710465 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7aed7377-38a8-43b3-9d7d-cd1816a17aca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:28.718964 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7aed7377-38a8-43b3-9d7d-cd1816a17aca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:28.720454 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7aed7377-38a8-43b3-9d7d-cd1816a17aca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:28.721623 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7aed7377-38a8-43b3-9d7d-cd1816a17aca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.171976 Sep 14 01:09:28.722337 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 269/538] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:28 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:09:28.724893 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-200c4e1a-bad3-42fd-85b7-b32dfabec0c6 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:28.725616 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-200c4e1a-bad3-42fd-85b7-b32dfabec0c6 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:28.733461 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-200c4e1a-bad3-42fd-85b7-b32dfabec0c6 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:28.733947 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-200c4e1a-bad3-42fd-85b7-b32dfabec0c6 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:28.735182 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-200c4e1a-bad3-42fd-85b7-b32dfabec0c6 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:28.735994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-200c4e1a-bad3-42fd-85b7-b32dfabec0c6 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:28.736455 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-200c4e1a-bad3-42fd-85b7-b32dfabec0c6 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:28.736924 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-200c4e1a-bad3-42fd-85b7-b32dfabec0c6 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:28.876310 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-200c4e1a-bad3-42fd-85b7-b32dfabec0c6 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:28.884501 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-200c4e1a-bad3-42fd-85b7-b32dfabec0c6 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1470 microversion: 2.1 time: 0.165743 Sep 14 01:09:28.891336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7ca13b41-8d12-4148-aea2-707cac14d0ba tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:28.892364 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7ca13b41-8d12-4148-aea2-707cac14d0ba tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:28.899833 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 270/539] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:28 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1470 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:09:28.901276 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ca13b41-8d12-4148-aea2-707cac14d0ba tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:28.902301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ca13b41-8d12-4148-aea2-707cac14d0ba tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:28.902771 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ca13b41-8d12-4148-aea2-707cac14d0ba tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:28.903439 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ca13b41-8d12-4148-aea2-707cac14d0ba tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:28.904041 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ca13b41-8d12-4148-aea2-707cac14d0ba tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:28.904345 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ca13b41-8d12-4148-aea2-707cac14d0ba tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:29.052596 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7ca13b41-8d12-4148-aea2-707cac14d0ba tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:29.061493 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7ca13b41-8d12-4148-aea2-707cac14d0ba tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1319 microversion: 2.1 time: 0.175087 Sep 14 01:09:29.062493 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 270/540] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:28 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:09:29.747457 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-519a0b58-2cc5-4aec-aa8d-3d68208590f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:29.748046 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-519a0b58-2cc5-4aec-aa8d-3d68208590f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:29.754943 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-519a0b58-2cc5-4aec-aa8d-3d68208590f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:29.755426 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-519a0b58-2cc5-4aec-aa8d-3d68208590f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:29.755888 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-519a0b58-2cc5-4aec-aa8d-3d68208590f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:29.756585 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-519a0b58-2cc5-4aec-aa8d-3d68208590f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:29.757040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-519a0b58-2cc5-4aec-aa8d-3d68208590f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:29.757468 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-519a0b58-2cc5-4aec-aa8d-3d68208590f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:29.893210 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-519a0b58-2cc5-4aec-aa8d-3d68208590f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:29.903142 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-519a0b58-2cc5-4aec-aa8d-3d68208590f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:29.904945 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-519a0b58-2cc5-4aec-aa8d-3d68208590f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:29.906121 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-519a0b58-2cc5-4aec-aa8d-3d68208590f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.162675 Sep 14 01:09:29.906682 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 271/541] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:29 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:09:29.908565 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d2703859-2547-4754-a0e4-8cad7f8c8c69 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:29.909235 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d2703859-2547-4754-a0e4-8cad7f8c8c69 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:29.916084 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d2703859-2547-4754-a0e4-8cad7f8c8c69 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:29.916649 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d2703859-2547-4754-a0e4-8cad7f8c8c69 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:29.917159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d2703859-2547-4754-a0e4-8cad7f8c8c69 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:29.917921 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d2703859-2547-4754-a0e4-8cad7f8c8c69 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:29.918448 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d2703859-2547-4754-a0e4-8cad7f8c8c69 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:29.918943 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d2703859-2547-4754-a0e4-8cad7f8c8c69 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:30.051750 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d2703859-2547-4754-a0e4-8cad7f8c8c69 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:30.060251 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d2703859-2547-4754-a0e4-8cad7f8c8c69 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1470 microversion: 2.1 time: 0.155701 Sep 14 01:09:30.060834 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 271/542] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:29 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:09:30.086922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0fd3dbda-3e27-4d6a-aec3-bc9f5a2255e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:30.087893 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0fd3dbda-3e27-4d6a-aec3-bc9f5a2255e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:30.094179 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0fd3dbda-3e27-4d6a-aec3-bc9f5a2255e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:30.094654 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0fd3dbda-3e27-4d6a-aec3-bc9f5a2255e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:30.095081 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0fd3dbda-3e27-4d6a-aec3-bc9f5a2255e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:30.095786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0fd3dbda-3e27-4d6a-aec3-bc9f5a2255e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:30.096233 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0fd3dbda-3e27-4d6a-aec3-bc9f5a2255e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:30.096649 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0fd3dbda-3e27-4d6a-aec3-bc9f5a2255e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:30.256674 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0fd3dbda-3e27-4d6a-aec3-bc9f5a2255e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:30.282044 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0fd3dbda-3e27-4d6a-aec3-bc9f5a2255e3 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1319 microversion: 2.1 time: 0.200203 Sep 14 01:09:30.297253 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 272/543] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:30 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:30.658707 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-5ac20343-c700-4dde-bc7d-94670f557643 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Action: 'create', calling method: .version_select at 0x7f5043ffc430>, body: {"keypair": {"name": "tempest-keypair-433840583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+5gJmj9uKNEqxQCDq2c0ANXdK3Es+jIR5VAqnFQmyqv/JzoLB2SagI/4Z+KssKMZ9U/2/Qp8lzp7x/Y1rjvZdZwUxwS0PRITWBDaRrtkywok8i+jIY7XcsfIKp4CDCLw=="}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:09:30.674500 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-5ac20343-c700-4dde-bc7d-94670f557643 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Getting quotas for project 62cb41eb4b8244abb4aafd718b1207ad. Resources: {'key_pairs'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:09:30.679366 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-5ac20343-c700-4dde-bc7d-94670f557643 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Getting quotas for user 51768890f19140b6819ef89f5bf610c8 and project 62cb41eb4b8244abb4aafd718b1207ad. Resources: {'key_pairs'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:09:30.705777 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-5ac20343-c700-4dde-bc7d-94670f557643 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051035 Sep 14 01:09:30.713434 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 272/544] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Sep 14 01:09:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:09:30.772160 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-e731314a-5b32-4c30-b2e6-be3ead933f40 req-73d4cf93-30e2-4e39-8fd7-89e6ec7a258e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23077ed0-85ab-48fb-a533-9a0f035f29c8", "name": "network-vif-deleted", "tag": "21627f84-f88e-4d81-bd53-27fd3579600b"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:09:30.801621 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-e731314a-5b32-4c30-b2e6-be3ead933f40 req-73d4cf93-30e2-4e39-8fd7-89e6ec7a258e service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:30.802108 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-e731314a-5b32-4c30-b2e6-be3ead933f40 req-73d4cf93-30e2-4e39-8fd7-89e6ec7a258e service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:30.809702 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-e731314a-5b32-4c30-b2e6-be3ead933f40 req-73d4cf93-30e2-4e39-8fd7-89e6ec7a258e service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:30.827979 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:30.831820 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-e731314a-5b32-4c30-b2e6-be3ead933f40 req-73d4cf93-30e2-4e39-8fd7-89e6ec7a258e service nova] Creating event network-vif-deleted:21627f84-f88e-4d81-bd53-27fd3579600b for instance 23077ed0-85ab-48fb-a533-9a0f035f29c8 on hv-cinder-85752 Sep 14 01:09:30.838321 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-e731314a-5b32-4c30-b2e6-be3ead933f40 req-73d4cf93-30e2-4e39-8fd7-89e6ec7a258e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076983 Sep 14 01:09:30.839579 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 273/545] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:09:30.933450 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-09d3fa10-1294-4762-b1ec-303a7a0c9145 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:30.934063 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-09d3fa10-1294-4762-b1ec-303a7a0c9145 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:30.943095 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-09d3fa10-1294-4762-b1ec-303a7a0c9145 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:30.943649 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-09d3fa10-1294-4762-b1ec-303a7a0c9145 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:30.944270 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-09d3fa10-1294-4762-b1ec-303a7a0c9145 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:30.944977 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-09d3fa10-1294-4762-b1ec-303a7a0c9145 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:30.946481 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-09d3fa10-1294-4762-b1ec-303a7a0c9145 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:30.946994 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-09d3fa10-1294-4762-b1ec-303a7a0c9145 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:31.073749 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-751e86af-d2cb-4f03-a0e5-a274fa0e762c req-fb974985-2bec-42c2-a2e7-d6241199613a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41efe3bb-948d-49f2-974e-c1d3b846b8a8", "name": "network-vif-plugged", "status": "completed", "tag": "775a97ae-c50c-4753-9069-80eb4c6633cf"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:09:31.110894 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-751e86af-d2cb-4f03-a0e5-a274fa0e762c req-fb974985-2bec-42c2-a2e7-d6241199613a service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:31.111698 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-751e86af-d2cb-4f03-a0e5-a274fa0e762c req-fb974985-2bec-42c2-a2e7-d6241199613a service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:31.112382 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-751e86af-d2cb-4f03-a0e5-a274fa0e762c req-fb974985-2bec-42c2-a2e7-d6241199613a service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:31.121089 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-09d3fa10-1294-4762-b1ec-303a7a0c9145 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:31.131540 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-09d3fa10-1294-4762-b1ec-303a7a0c9145 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:31.133176 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-09d3fa10-1294-4762-b1ec-303a7a0c9145 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:31.134380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-09d3fa10-1294-4762-b1ec-303a7a0c9145 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.205630 Sep 14 01:09:31.135300 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 273/546] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:30 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:09:31.136084 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-751e86af-d2cb-4f03-a0e5-a274fa0e762c req-fb974985-2bec-42c2-a2e7-d6241199613a service nova] Creating event network-vif-plugged:775a97ae-c50c-4753-9069-80eb4c6633cf for instance 41efe3bb-948d-49f2-974e-c1d3b846b8a8 on hv-cinder-85752 Sep 14 01:09:31.140840 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8dc51ef4-3ce2-425f-8aa1-ee597e1fb108 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:31.141449 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8dc51ef4-3ce2-425f-8aa1-ee597e1fb108 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:31.147986 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8dc51ef4-3ce2-425f-8aa1-ee597e1fb108 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:31.148805 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8dc51ef4-3ce2-425f-8aa1-ee597e1fb108 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:31.149510 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8dc51ef4-3ce2-425f-8aa1-ee597e1fb108 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:31.151084 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8dc51ef4-3ce2-425f-8aa1-ee597e1fb108 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:31.151757 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8dc51ef4-3ce2-425f-8aa1-ee597e1fb108 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:31.152358 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8dc51ef4-3ce2-425f-8aa1-ee597e1fb108 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:31.155188 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-751e86af-d2cb-4f03-a0e5-a274fa0e762c req-fb974985-2bec-42c2-a2e7-d6241199613a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086941 Sep 14 01:09:31.156139 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 274/547] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:09:31.188856 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8dc51ef4-3ce2-425f-8aa1-ee597e1fb108 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:31.189590 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8dc51ef4-3ce2-425f-8aa1-ee597e1fb108 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:31.190028 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8dc51ef4-3ce2-425f-8aa1-ee597e1fb108 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:31.190471 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-8dc51ef4-3ce2-425f-8aa1-ee597e1fb108 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lazy-loading 'fault' on Instance uuid 23077ed0-85ab-48fb-a533-9a0f035f29c8 {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:09:31.249501 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8dc51ef4-3ce2-425f-8aa1-ee597e1fb108 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:31.266999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8dc51ef4-3ce2-425f-8aa1-ee597e1fb108 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1305 microversion: 2.1 time: 0.129589 Sep 14 01:09:31.267925 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 274/548] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:31 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1305 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:31.310232 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-870d5f43-18aa-4a20-bf33-1abba7aad1f8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:31.310988 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-870d5f43-18aa-4a20-bf33-1abba7aad1f8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:31.333023 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-870d5f43-18aa-4a20-bf33-1abba7aad1f8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:31.333659 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-870d5f43-18aa-4a20-bf33-1abba7aad1f8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:31.334445 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-870d5f43-18aa-4a20-bf33-1abba7aad1f8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:31.335618 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-870d5f43-18aa-4a20-bf33-1abba7aad1f8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:31.336413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-870d5f43-18aa-4a20-bf33-1abba7aad1f8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:31.341907 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-870d5f43-18aa-4a20-bf33-1abba7aad1f8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:31.529771 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-870d5f43-18aa-4a20-bf33-1abba7aad1f8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:31.542878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-870d5f43-18aa-4a20-bf33-1abba7aad1f8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1319 microversion: 2.1 time: 0.238068 Sep 14 01:09:31.544045 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 275/549] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:31 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:32.160464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-c6d56adf-a39f-4da1-8b83-2226b4a2b806 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:32.161075 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-c6d56adf-a39f-4da1-8b83-2226b4a2b806 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:32.168228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c6d56adf-a39f-4da1-8b83-2226b4a2b806 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:32.168719 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c6d56adf-a39f-4da1-8b83-2226b4a2b806 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:32.169156 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c6d56adf-a39f-4da1-8b83-2226b4a2b806 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:32.169858 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c6d56adf-a39f-4da1-8b83-2226b4a2b806 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:32.170310 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c6d56adf-a39f-4da1-8b83-2226b4a2b806 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:32.170732 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c6d56adf-a39f-4da1-8b83-2226b4a2b806 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:32.297016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-56d6706a-c38e-4d69-a916-8c3b10a81410 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:32.298415 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-56d6706a-c38e-4d69-a916-8c3b10a81410 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:32.305407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56d6706a-c38e-4d69-a916-8c3b10a81410 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:32.305891 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56d6706a-c38e-4d69-a916-8c3b10a81410 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:32.306319 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56d6706a-c38e-4d69-a916-8c3b10a81410 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:32.307010 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56d6706a-c38e-4d69-a916-8c3b10a81410 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:32.307460 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56d6706a-c38e-4d69-a916-8c3b10a81410 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:32.308073 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56d6706a-c38e-4d69-a916-8c3b10a81410 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:32.348015 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56d6706a-c38e-4d69-a916-8c3b10a81410 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:32.348769 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56d6706a-c38e-4d69-a916-8c3b10a81410 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:32.349213 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56d6706a-c38e-4d69-a916-8c3b10a81410 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:32.349663 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-56d6706a-c38e-4d69-a916-8c3b10a81410 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lazy-loading 'fault' on Instance uuid 23077ed0-85ab-48fb-a533-9a0f035f29c8 {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:09:32.390957 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-56d6706a-c38e-4d69-a916-8c3b10a81410 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933fbde6e9e0421eb7da2b7bd7850b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a4cb96eea945b8aeabe1ee77293241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:32.396095 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c6d56adf-a39f-4da1-8b83-2226b4a2b806 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:32.399943 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-56d6706a-c38e-4d69-a916-8c3b10a81410 tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 200 len: 1305 microversion: 2.1 time: 0.106816 Sep 14 01:09:32.400778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 276/550] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:32 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 1305 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:32.407501 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c6d56adf-a39f-4da1-8b83-2226b4a2b806 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:32.409001 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c6d56adf-a39f-4da1-8b83-2226b4a2b806 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:32.410959 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-c6d56adf-a39f-4da1-8b83-2226b4a2b806 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.254601 Sep 14 01:09:32.417467 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 275/551] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:32 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:09:32.567524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ab870f57-83c9-493d-ba54-5ba41cf27b61 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:32.568351 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ab870f57-83c9-493d-ba54-5ba41cf27b61 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:32.574846 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab870f57-83c9-493d-ba54-5ba41cf27b61 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:32.575430 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab870f57-83c9-493d-ba54-5ba41cf27b61 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:32.576086 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab870f57-83c9-493d-ba54-5ba41cf27b61 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:32.576988 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab870f57-83c9-493d-ba54-5ba41cf27b61 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:32.577491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab870f57-83c9-493d-ba54-5ba41cf27b61 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:32.578087 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab870f57-83c9-493d-ba54-5ba41cf27b61 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:32.730286 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ab870f57-83c9-493d-ba54-5ba41cf27b61 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:32.739628 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ab870f57-83c9-493d-ba54-5ba41cf27b61 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1319 microversion: 2.1 time: 0.176666 Sep 14 01:09:32.746707 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 277/552] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:32 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:32.765467 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a2fd38d3-66f2-490e-a467-87e95dc6536c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-456357411", "imageRef": "a2619027-0d8b-4ca3-9528-1ac3380cab5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a458fb77-0452-4eef-a570-bd92e833719b"}], "security_groups": [{"name": "tempest-securitygroup--8022688"}], "key_name": "tempest-keypair-433840583", "user_data": "}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:09:32.889694 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.network.neutron [None req-a2fd38d3-66f2-490e-a467-87e95dc6536c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] validate_networks() for [('a458fb77-0452-4eef-a570-bd92e833719b', None, None, None, None, None)] {{(pid=120620) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:09:33.297606 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-a2fd38d3-66f2-490e-a467-87e95dc6536c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Flavor limits 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:09:33.298184 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-a2fd38d3-66f2-490e-a467-87e95dc6536c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Image limits 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:09:33.298506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-a2fd38d3-66f2-490e-a467-87e95dc6536c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Flavor pref 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:09:33.298954 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-a2fd38d3-66f2-490e-a467-87e95dc6536c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Image pref 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:09:33.299355 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-a2fd38d3-66f2-490e-a467-87e95dc6536c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:09:33.309584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a2fd38d3-66f2-490e-a467-87e95dc6536c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:33.310109 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a2fd38d3-66f2-490e-a467-87e95dc6536c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:33.310551 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a2fd38d3-66f2-490e-a467-87e95dc6536c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:33.311384 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a2fd38d3-66f2-490e-a467-87e95dc6536c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:33.311968 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a2fd38d3-66f2-490e-a467-87e95dc6536c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:33.312405 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a2fd38d3-66f2-490e-a467-87e95dc6536c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:33.329557 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-a2fd38d3-66f2-490e-a467-87e95dc6536c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Getting quotas for project 62cb41eb4b8244abb4aafd718b1207ad. Resources: {'cores', 'instances', 'ram'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:09:33.333641 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-a2fd38d3-66f2-490e-a467-87e95dc6536c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Getting quotas for user 51768890f19140b6819ef89f5bf610c8 and project 62cb41eb4b8244abb4aafd718b1207ad. Resources: {'cores', 'instances', 'ram'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:09:33.345210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a2fd38d3-66f2-490e-a467-87e95dc6536c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Going to run 1 instances... {{(pid=120620) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:09:33.348212 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a2fd38d3-66f2-490e-a467-87e95dc6536c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a2619027-0d8b-4ca3-9528-1ac3380cab5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120620) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:09:33.398158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a2fd38d3-66f2-490e-a467-87e95dc6536c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.637303 Sep 14 01:09:33.405341 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 276/553] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 01:09:32 2022] POST /compute/v2.1/servers => generated 399 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 01:09:33.410764 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fd9a7f60-e32e-4636-86ce-f3a4a970578c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:33.411724 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fd9a7f60-e32e-4636-86ce-f3a4a970578c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:33.424802 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0c1e6731-09b0-4b86-b0b1-b4cbefafaf3f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:33.425425 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0c1e6731-09b0-4b86-b0b1-b4cbefafaf3f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] [instance: 23077ed0-85ab-48fb-a533-9a0f035f29c8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:33.434503 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0c1e6731-09b0-4b86-b0b1-b4cbefafaf3f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:33.435020 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0c1e6731-09b0-4b86-b0b1-b4cbefafaf3f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:33.435460 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0c1e6731-09b0-4b86-b0b1-b4cbefafaf3f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:33.436342 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0c1e6731-09b0-4b86-b0b1-b4cbefafaf3f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:33.436805 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0c1e6731-09b0-4b86-b0b1-b4cbefafaf3f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:33.437229 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0c1e6731-09b0-4b86-b0b1-b4cbefafaf3f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:33.453637 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-0c1e6731-09b0-4b86-b0b1-b4cbefafaf3f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] HTTP exception thrown: Instance 23077ed0-85ab-48fb-a533-9a0f035f29c8 could not be found. Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0c1e6731-09b0-4b86-b0b1-b4cbefafaf3f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Request method failure captured: Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 HTTP/1.1 Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISmcRdJ7lHrmK2rqc9-v8p-4cynQ3RUB-Zi7bPZOccbQnaUjupJo4Z1ne0WVvuve8W6kVYEvviXeM2MimAsrCw9ZZxvRrb3xaMFldfPyOVKMXekuyelYo5uAc0Nmf2C5TrbHSgrnownzEu-WOXvPV20RBho8QxkaBH28B70st_4KfEU Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: c3a4cb96eea945b8aeabe1ee77293241 Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-VolumesNegativeTest-577881517 Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:09:33.455486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:09:33.457720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c3a4cb96eea945b8aeabe1ee77293241"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c3a4cb96eea945b8aeabe1ee77293241"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c3a4cb96eea945b8aeabe1ee77293241"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c3a4cb96eea945b8aeabe1ee77293241"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:09:33.457720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-VolumesNegativeTest-577881517 Sep 14 01:09:33.457720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: c3a4cb96eea945b8aeabe1ee77293241 Sep 14 01:09:33.457720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-VolumesNegativeTest-577881517 Sep 14 01:09:33.457720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-VolumesNegativeTest-577881517-project Sep 14 01:09:33.457720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:09:33.457720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:09:33.457720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: 933fbde6e9e0421eb7da2b7bd7850b84 Sep 14 01:09:33.457720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-VolumesNegativeTest-577881517-project Sep 14 01:09:33.457720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:09:33.457720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance 23077ed0-85ab-48fb-a533-9a0f035f29c8 could not be found. Sep 14 01:09:33.457720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': '23077ed0-85ab-48fb-a533-9a0f035f29c8'} Sep 14 01:09:33.459048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:09:33.459048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:09:33.459048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:09:33.459048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:09:33.459048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:09:33.459048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:09:33.459048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:09:33.459048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:09:33.459048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:09:33.459048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:09:33.459048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23077ed0-85ab-48fb-a533-9a0f035f29c8 could not be found. Sep 14 01:09:33.459048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:09:33.459048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:09:33.459048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:09:33.459048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:09:33.459048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:09:33.459048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:09:33.459048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:09:33.459048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:09:33.459048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:09:33.460336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:09:33.460336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:09:33.460336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:09:33.460336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:09:33.460336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:09:33.460336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:09:33.460336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:09:33.460336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23077ed0-85ab-48fb-a533-9a0f035f29c8 could not be found. Sep 14 01:09:33.460336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:09:33.460336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:09:33.460336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:09:33.460336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:09:33.460336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:09:33.460336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:09:33.460336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:09:33.460336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:09:33.460336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23077ed0-85ab-48fb-a533-9a0f035f29c8 could not be found. Sep 14 01:09:33.460336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:09:33.462216 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0c1e6731-09b0-4b86-b0b1-b4cbefafaf3f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] Returning 404 to user: Instance 23077ed0-85ab-48fb-a533-9a0f035f29c8 could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:09:33.462216 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0c1e6731-09b0-4b86-b0b1-b4cbefafaf3f tempest-VolumesNegativeTest-577881517 tempest-VolumesNegativeTest-577881517-project] 10.222.0.42 "GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8" status: 404 len: 111 microversion: 2.1 time: 0.037818 Sep 14 01:09:33.462216 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 277/554] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:33 2022] GET /compute/v2.1/servers/23077ed0-85ab-48fb-a533-9a0f035f29c8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 01:09:33.468605 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-77d5c953-d4d7-410d-bf3d-8044b9e5e439 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:33.469950 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-77d5c953-d4d7-410d-bf3d-8044b9e5e439 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:33.479203 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-77d5c953-d4d7-410d-bf3d-8044b9e5e439 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:33.480092 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-77d5c953-d4d7-410d-bf3d-8044b9e5e439 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:33.480696 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-77d5c953-d4d7-410d-bf3d-8044b9e5e439 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:33.481553 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-77d5c953-d4d7-410d-bf3d-8044b9e5e439 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:33.482157 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-77d5c953-d4d7-410d-bf3d-8044b9e5e439 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:33.482778 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-77d5c953-d4d7-410d-bf3d-8044b9e5e439 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:33.544929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fd9a7f60-e32e-4636-86ce-f3a4a970578c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:33.552655 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fd9a7f60-e32e-4636-86ce-f3a4a970578c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1240 microversion: 2.1 time: 0.145880 Sep 14 01:09:33.553908 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 278/555] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:33 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1240 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:33.689183 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-77d5c953-d4d7-410d-bf3d-8044b9e5e439 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:33.706006 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-77d5c953-d4d7-410d-bf3d-8044b9e5e439 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:33.708307 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-77d5c953-d4d7-410d-bf3d-8044b9e5e439 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:33.710023 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-77d5c953-d4d7-410d-bf3d-8044b9e5e439 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.250262 Sep 14 01:09:33.710802 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 278/556] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:33 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:09:33.763445 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d64c3494-3dba-4fdc-a5a3-ceeb6c053b8b tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:33.764122 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d64c3494-3dba-4fdc-a5a3-ceeb6c053b8b tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:33.773670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d64c3494-3dba-4fdc-a5a3-ceeb6c053b8b tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:33.774552 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d64c3494-3dba-4fdc-a5a3-ceeb6c053b8b tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:33.774689 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d64c3494-3dba-4fdc-a5a3-ceeb6c053b8b tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:33.775359 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d64c3494-3dba-4fdc-a5a3-ceeb6c053b8b tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:33.775835 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d64c3494-3dba-4fdc-a5a3-ceeb6c053b8b tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:33.776322 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d64c3494-3dba-4fdc-a5a3-ceeb6c053b8b tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:33.978011 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d64c3494-3dba-4fdc-a5a3-ceeb6c053b8b tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:33.987808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d64c3494-3dba-4fdc-a5a3-ceeb6c053b8b tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1319 microversion: 2.1 time: 0.229132 Sep 14 01:09:33.989236 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 279/557] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:33 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:34.577044 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ac744955-9c46-4816-becd-99a51736eeec tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:34.578409 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ac744955-9c46-4816-becd-99a51736eeec tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:34.580842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:34.586565 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac744955-9c46-4816-becd-99a51736eeec tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:34.587408 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac744955-9c46-4816-becd-99a51736eeec tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:34.591705 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac744955-9c46-4816-becd-99a51736eeec tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:34.593392 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac744955-9c46-4816-becd-99a51736eeec tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:34.594151 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac744955-9c46-4816-becd-99a51736eeec tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:34.595266 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac744955-9c46-4816-becd-99a51736eeec tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:34.670368 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ac744955-9c46-4816-becd-99a51736eeec tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:34.680142 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ac744955-9c46-4816-becd-99a51736eeec tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1236 microversion: 2.1 time: 0.106865 Sep 14 01:09:34.681286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 279/558] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:34 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1236 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:34.736357 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-09f24c61-9dbd-451a-9dd0-417f7b9e6c06 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:34.736970 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-09f24c61-9dbd-451a-9dd0-417f7b9e6c06 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:34.744378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-09f24c61-9dbd-451a-9dd0-417f7b9e6c06 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:34.744874 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-09f24c61-9dbd-451a-9dd0-417f7b9e6c06 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:34.745315 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-09f24c61-9dbd-451a-9dd0-417f7b9e6c06 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:34.746248 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-09f24c61-9dbd-451a-9dd0-417f7b9e6c06 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:34.746711 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-09f24c61-9dbd-451a-9dd0-417f7b9e6c06 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:34.747146 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-09f24c61-9dbd-451a-9dd0-417f7b9e6c06 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:34.896798 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-09f24c61-9dbd-451a-9dd0-417f7b9e6c06 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:34.908685 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-09f24c61-9dbd-451a-9dd0-417f7b9e6c06 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:34.910449 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-09f24c61-9dbd-451a-9dd0-417f7b9e6c06 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:34.911758 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-09f24c61-9dbd-451a-9dd0-417f7b9e6c06 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.179225 Sep 14 01:09:34.924002 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 280/559] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:34 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:09:35.012234 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-1c704d30-1402-47e3-b897-e6dc5eab510d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:35.012998 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-1c704d30-1402-47e3-b897-e6dc5eab510d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:35.020613 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1c704d30-1402-47e3-b897-e6dc5eab510d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:35.021325 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1c704d30-1402-47e3-b897-e6dc5eab510d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:35.021768 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1c704d30-1402-47e3-b897-e6dc5eab510d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:35.022474 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1c704d30-1402-47e3-b897-e6dc5eab510d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:35.022932 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1c704d30-1402-47e3-b897-e6dc5eab510d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:35.023357 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1c704d30-1402-47e3-b897-e6dc5eab510d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:35.190265 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-1c704d30-1402-47e3-b897-e6dc5eab510d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:35.212987 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-1c704d30-1402-47e3-b897-e6dc5eab510d tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1506 microversion: 2.1 time: 0.205091 Sep 14 01:09:35.213582 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 280/560] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:35 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1506 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:35.240496 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-19f9ac60-b78f-4020-a3e5-31603e381811 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e706b2aa-470d-4396-ba13-c316a5f5fdde", "device": "/dev/sdb"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:09:35.246495 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-19f9ac60-b78f-4020-a3e5-31603e381811 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:35.253392 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-19f9ac60-b78f-4020-a3e5-31603e381811 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:35.253963 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-19f9ac60-b78f-4020-a3e5-31603e381811 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:35.254406 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-19f9ac60-b78f-4020-a3e5-31603e381811 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:35.255115 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-19f9ac60-b78f-4020-a3e5-31603e381811 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:35.256408 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-19f9ac60-b78f-4020-a3e5-31603e381811 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:35.256846 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-19f9ac60-b78f-4020-a3e5-31603e381811 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:35.713064 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-34b59cf9-8490-4123-b691-2a63a311f3ee tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:35.718185 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-34b59cf9-8490-4123-b691-2a63a311f3ee tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:35.719825 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-19f9ac60-b78f-4020-a3e5-31603e381811 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "POST /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.483594 Sep 14 01:09:35.720952 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 281/561] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 01:09:35 2022] POST /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8/os-volume_attachments => generated 194 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:09:35.760327 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-34b59cf9-8490-4123-b691-2a63a311f3ee tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:35.763508 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-34b59cf9-8490-4123-b691-2a63a311f3ee tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:35.768273 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-34b59cf9-8490-4123-b691-2a63a311f3ee tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:35.769743 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-34b59cf9-8490-4123-b691-2a63a311f3ee tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:35.770869 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-34b59cf9-8490-4123-b691-2a63a311f3ee tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:35.771842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-34b59cf9-8490-4123-b691-2a63a311f3ee tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:35.874515 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-34b59cf9-8490-4123-b691-2a63a311f3ee tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:35.890811 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-34b59cf9-8490-4123-b691-2a63a311f3ee tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1298 microversion: 2.1 time: 0.184813 Sep 14 01:09:35.890811 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 281/562] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:35 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1298 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:35.941343 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-65abebac-fee6-439a-81a7-c75a8acab12d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:35.943396 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-65abebac-fee6-439a-81a7-c75a8acab12d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:35.953363 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-65abebac-fee6-439a-81a7-c75a8acab12d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:35.954229 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-65abebac-fee6-439a-81a7-c75a8acab12d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:35.954814 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-65abebac-fee6-439a-81a7-c75a8acab12d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:35.955528 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-65abebac-fee6-439a-81a7-c75a8acab12d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:35.956000 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-65abebac-fee6-439a-81a7-c75a8acab12d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:35.957479 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-65abebac-fee6-439a-81a7-c75a8acab12d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:36.127588 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-65abebac-fee6-439a-81a7-c75a8acab12d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:36.140903 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-65abebac-fee6-439a-81a7-c75a8acab12d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:36.141583 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-65abebac-fee6-439a-81a7-c75a8acab12d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:36.142961 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-65abebac-fee6-439a-81a7-c75a8acab12d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.207021 Sep 14 01:09:36.143605 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 282/563] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:35 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:09:36.915105 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4780a5cd-cd16-4c70-a383-cd44b788eb99 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:36.915750 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4780a5cd-cd16-4c70-a383-cd44b788eb99 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:36.922124 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4780a5cd-cd16-4c70-a383-cd44b788eb99 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:36.922507 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4780a5cd-cd16-4c70-a383-cd44b788eb99 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:36.923121 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4780a5cd-cd16-4c70-a383-cd44b788eb99 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:36.923862 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4780a5cd-cd16-4c70-a383-cd44b788eb99 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:36.924319 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4780a5cd-cd16-4c70-a383-cd44b788eb99 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:36.924900 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4780a5cd-cd16-4c70-a383-cd44b788eb99 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:37.172775 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-be61e310-5f57-40f9-8601-7f18c82f8bb3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:37.173720 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-be61e310-5f57-40f9-8601-7f18c82f8bb3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:37.174858 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4780a5cd-cd16-4c70-a383-cd44b788eb99 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:37.180947 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be61e310-5f57-40f9-8601-7f18c82f8bb3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:37.181432 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be61e310-5f57-40f9-8601-7f18c82f8bb3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:37.182127 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be61e310-5f57-40f9-8601-7f18c82f8bb3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:37.182813 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4780a5cd-cd16-4c70-a383-cd44b788eb99 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1363 microversion: 2.1 time: 0.271338 Sep 14 01:09:37.182932 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be61e310-5f57-40f9-8601-7f18c82f8bb3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:37.183285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be61e310-5f57-40f9-8601-7f18c82f8bb3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:37.183736 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be61e310-5f57-40f9-8601-7f18c82f8bb3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:37.194878 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 282/564] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:36 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:37.327176 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-be61e310-5f57-40f9-8601-7f18c82f8bb3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:37.337352 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-be61e310-5f57-40f9-8601-7f18c82f8bb3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:37.338824 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-be61e310-5f57-40f9-8601-7f18c82f8bb3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:37.340013 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-be61e310-5f57-40f9-8601-7f18c82f8bb3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.171530 Sep 14 01:09:37.340561 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 283/565] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:37 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:09:37.583206 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-b4d3cf4e-b7b5-49d2-95f8-4a287dcf8b96 req-4dc0f2f0-b42c-4ea3-a866-d71d35b977c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09c7d241-afe4-4cee-a009-fa481d6abe5e", "tag": "11bcbd99-dcf9-4ee8-ae91-4d0de4546447"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:09:37.592387 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-b4d3cf4e-b7b5-49d2-95f8-4a287dcf8b96 req-4dc0f2f0-b42c-4ea3-a866-d71d35b977c3 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:37.592856 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-b4d3cf4e-b7b5-49d2-95f8-4a287dcf8b96 req-4dc0f2f0-b42c-4ea3-a866-d71d35b977c3 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:37.593461 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-b4d3cf4e-b7b5-49d2-95f8-4a287dcf8b96 req-4dc0f2f0-b42c-4ea3-a866-d71d35b977c3 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:37.604326 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-b4d3cf4e-b7b5-49d2-95f8-4a287dcf8b96 req-4dc0f2f0-b42c-4ea3-a866-d71d35b977c3 service nova] Creating event network-changed:11bcbd99-dcf9-4ee8-ae91-4d0de4546447 for instance 09c7d241-afe4-4cee-a009-fa481d6abe5e on hv-cinder-85752 Sep 14 01:09:37.609431 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-b4d3cf4e-b7b5-49d2-95f8-4a287dcf8b96 req-4dc0f2f0-b42c-4ea3-a866-d71d35b977c3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030203 Sep 14 01:09:37.610021 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 283/566] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:09:38.207066 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6f94d537-eec0-492d-960e-66b632edbb7c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:38.207784 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6f94d537-eec0-492d-960e-66b632edbb7c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:38.215397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6f94d537-eec0-492d-960e-66b632edbb7c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:38.215916 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6f94d537-eec0-492d-960e-66b632edbb7c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:38.216349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6f94d537-eec0-492d-960e-66b632edbb7c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:38.217042 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6f94d537-eec0-492d-960e-66b632edbb7c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:38.217495 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6f94d537-eec0-492d-960e-66b632edbb7c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:38.217898 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6f94d537-eec0-492d-960e-66b632edbb7c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:38.367461 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-80482f5d-e407-48ed-befb-0071a4de799a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:38.368261 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-80482f5d-e407-48ed-befb-0071a4de799a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:38.374585 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-80482f5d-e407-48ed-befb-0071a4de799a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:38.375424 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-80482f5d-e407-48ed-befb-0071a4de799a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:38.375827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-80482f5d-e407-48ed-befb-0071a4de799a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:38.376528 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-80482f5d-e407-48ed-befb-0071a4de799a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:38.377159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-80482f5d-e407-48ed-befb-0071a4de799a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:38.377743 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-80482f5d-e407-48ed-befb-0071a4de799a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:38.625110 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6f94d537-eec0-492d-960e-66b632edbb7c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:38.634631 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6f94d537-eec0-492d-960e-66b632edbb7c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1363 microversion: 2.1 time: 0.432156 Sep 14 01:09:38.635304 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 284/567] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:38 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1363 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:38.787258 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-80482f5d-e407-48ed-befb-0071a4de799a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:38.795284 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-80482f5d-e407-48ed-befb-0071a4de799a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:38.796768 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-80482f5d-e407-48ed-befb-0071a4de799a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:38.797929 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-80482f5d-e407-48ed-befb-0071a4de799a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.435543 Sep 14 01:09:38.798489 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 284/568] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:38 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:09:39.093624 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d306314d-c29d-45b6-8cee-5469f664c3c2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:09:39.102291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d306314d-c29d-45b6-8cee-5469f664c3c2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:39.103052 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d306314d-c29d-45b6-8cee-5469f664c3c2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:39.103621 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d306314d-c29d-45b6-8cee-5469f664c3c2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:39.170506 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d306314d-c29d-45b6-8cee-5469f664c3c2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Going to try to stop instance {{(pid=120621) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 01:09:39.213976 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d306314d-c29d-45b6-8cee-5469f664c3c2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "POST /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32/action" status: 202 len: 0 microversion: 2.1 time: 0.124713 Sep 14 01:09:39.214631 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 285/569] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 01:09:39 2022] POST /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 01:09:39.222876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8d8ebced-7ce5-4074-aa9f-cccbf7b90f4d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:39.223605 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8d8ebced-7ce5-4074-aa9f-cccbf7b90f4d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:39.229770 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d8ebced-7ce5-4074-aa9f-cccbf7b90f4d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:39.230259 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d8ebced-7ce5-4074-aa9f-cccbf7b90f4d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:39.230703 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d8ebced-7ce5-4074-aa9f-cccbf7b90f4d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:39.231400 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d8ebced-7ce5-4074-aa9f-cccbf7b90f4d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:39.231898 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d8ebced-7ce5-4074-aa9f-cccbf7b90f4d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:39.232332 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d8ebced-7ce5-4074-aa9f-cccbf7b90f4d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:39.423921 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8d8ebced-7ce5-4074-aa9f-cccbf7b90f4d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:39.427641 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=100 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:39.433511 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8d8ebced-7ce5-4074-aa9f-cccbf7b90f4d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1721 microversion: 2.1 time: 0.214547 Sep 14 01:09:39.434082 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 285/570] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:39 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:39.658510 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9eaa7507-a10f-44c5-a98d-aba3dbe537ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:39.659152 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9eaa7507-a10f-44c5-a98d-aba3dbe537ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:39.666262 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9eaa7507-a10f-44c5-a98d-aba3dbe537ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:39.666743 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9eaa7507-a10f-44c5-a98d-aba3dbe537ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:39.667171 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9eaa7507-a10f-44c5-a98d-aba3dbe537ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:39.667896 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9eaa7507-a10f-44c5-a98d-aba3dbe537ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:39.668347 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9eaa7507-a10f-44c5-a98d-aba3dbe537ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:39.668772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9eaa7507-a10f-44c5-a98d-aba3dbe537ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:39.799442 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9eaa7507-a10f-44c5-a98d-aba3dbe537ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:39.807353 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9eaa7507-a10f-44c5-a98d-aba3dbe537ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1363 microversion: 2.1 time: 0.153216 Sep 14 01:09:39.807950 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 286/571] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:39 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:39.824724 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-de2d37b7-b544-4009-8148-adc84dbac2df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:39.825333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-de2d37b7-b544-4009-8148-adc84dbac2df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:39.831355 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-de2d37b7-b544-4009-8148-adc84dbac2df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:39.831872 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-de2d37b7-b544-4009-8148-adc84dbac2df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:39.832312 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-de2d37b7-b544-4009-8148-adc84dbac2df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:39.833672 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-de2d37b7-b544-4009-8148-adc84dbac2df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:39.834225 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-de2d37b7-b544-4009-8148-adc84dbac2df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:39.834637 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-de2d37b7-b544-4009-8148-adc84dbac2df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:39.962741 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-de2d37b7-b544-4009-8148-adc84dbac2df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:39.970966 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-de2d37b7-b544-4009-8148-adc84dbac2df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:39.972432 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-de2d37b7-b544-4009-8148-adc84dbac2df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:39.973767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-de2d37b7-b544-4009-8148-adc84dbac2df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.152809 Sep 14 01:09:39.974421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 286/572] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:39 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:09:40.457966 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3462e160-dc22-4db7-a470-e84057c2f010 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:40.458634 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3462e160-dc22-4db7-a470-e84057c2f010 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:40.465140 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3462e160-dc22-4db7-a470-e84057c2f010 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:40.465626 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3462e160-dc22-4db7-a470-e84057c2f010 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:40.466064 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3462e160-dc22-4db7-a470-e84057c2f010 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:40.466756 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3462e160-dc22-4db7-a470-e84057c2f010 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:40.467211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3462e160-dc22-4db7-a470-e84057c2f010 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:40.467665 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3462e160-dc22-4db7-a470-e84057c2f010 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:40.593899 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3462e160-dc22-4db7-a470-e84057c2f010 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:40.601934 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3462e160-dc22-4db7-a470-e84057c2f010 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1721 microversion: 2.1 time: 0.147913 Sep 14 01:09:40.602493 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 287/573] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:40 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:40.830538 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-fe520113-7bd5-406a-bc13-9dc94c5903c0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:40.831156 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-fe520113-7bd5-406a-bc13-9dc94c5903c0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:40.837675 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fe520113-7bd5-406a-bc13-9dc94c5903c0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:40.838164 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fe520113-7bd5-406a-bc13-9dc94c5903c0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:40.838603 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fe520113-7bd5-406a-bc13-9dc94c5903c0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:40.839298 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fe520113-7bd5-406a-bc13-9dc94c5903c0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:40.839786 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fe520113-7bd5-406a-bc13-9dc94c5903c0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:40.840214 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fe520113-7bd5-406a-bc13-9dc94c5903c0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:40.970494 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-fe520113-7bd5-406a-bc13-9dc94c5903c0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:40.979145 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-fe520113-7bd5-406a-bc13-9dc94c5903c0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1363 microversion: 2.1 time: 0.152475 Sep 14 01:09:40.979728 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 287/574] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:40 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:40.998343 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-14fe9d8e-fef4-4d37-96d4-4cec71dbd57b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:40.998971 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-14fe9d8e-fef4-4d37-96d4-4cec71dbd57b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:41.004914 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-14fe9d8e-fef4-4d37-96d4-4cec71dbd57b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:41.005402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-14fe9d8e-fef4-4d37-96d4-4cec71dbd57b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:41.005838 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-14fe9d8e-fef4-4d37-96d4-4cec71dbd57b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:41.006533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-14fe9d8e-fef4-4d37-96d4-4cec71dbd57b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:41.006988 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-14fe9d8e-fef4-4d37-96d4-4cec71dbd57b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:41.007414 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-14fe9d8e-fef4-4d37-96d4-4cec71dbd57b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:41.140334 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-14fe9d8e-fef4-4d37-96d4-4cec71dbd57b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:41.149253 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-14fe9d8e-fef4-4d37-96d4-4cec71dbd57b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:41.150820 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-14fe9d8e-fef4-4d37-96d4-4cec71dbd57b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:41.152094 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-14fe9d8e-fef4-4d37-96d4-4cec71dbd57b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.157843 Sep 14 01:09:41.152718 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 288/575] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:40 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:09:41.625872 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-70e23a84-a6f7-46c4-825f-e556c45d7793 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:41.626478 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-70e23a84-a6f7-46c4-825f-e556c45d7793 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:41.632871 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-70e23a84-a6f7-46c4-825f-e556c45d7793 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:41.633351 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-70e23a84-a6f7-46c4-825f-e556c45d7793 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:41.633783 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-70e23a84-a6f7-46c4-825f-e556c45d7793 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:41.634461 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-70e23a84-a6f7-46c4-825f-e556c45d7793 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:41.634941 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-70e23a84-a6f7-46c4-825f-e556c45d7793 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:41.635357 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-70e23a84-a6f7-46c4-825f-e556c45d7793 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:41.762576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-70e23a84-a6f7-46c4-825f-e556c45d7793 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:41.771301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-70e23a84-a6f7-46c4-825f-e556c45d7793 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1721 microversion: 2.1 time: 0.149327 Sep 14 01:09:41.771886 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 288/576] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:41 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:42.002833 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a71551dd-8eca-4b84-b336-7776fc5ed2d2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:42.003443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a71551dd-8eca-4b84-b336-7776fc5ed2d2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:42.010583 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a71551dd-8eca-4b84-b336-7776fc5ed2d2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:42.011003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a71551dd-8eca-4b84-b336-7776fc5ed2d2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:42.011727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a71551dd-8eca-4b84-b336-7776fc5ed2d2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:42.012411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a71551dd-8eca-4b84-b336-7776fc5ed2d2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:42.012863 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a71551dd-8eca-4b84-b336-7776fc5ed2d2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:42.013285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a71551dd-8eca-4b84-b336-7776fc5ed2d2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:42.032362 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:42.142262 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a71551dd-8eca-4b84-b336-7776fc5ed2d2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:42.149921 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a71551dd-8eca-4b84-b336-7776fc5ed2d2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1363 microversion: 2.1 time: 0.150994 Sep 14 01:09:42.150479 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 289/577] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:41 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:42.177988 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-c1cce511-29f7-4186-914d-da44ca603225 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:42.178598 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-c1cce511-29f7-4186-914d-da44ca603225 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:42.185273 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c1cce511-29f7-4186-914d-da44ca603225 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:42.185758 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c1cce511-29f7-4186-914d-da44ca603225 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:42.186193 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c1cce511-29f7-4186-914d-da44ca603225 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:42.186900 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c1cce511-29f7-4186-914d-da44ca603225 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:42.187372 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c1cce511-29f7-4186-914d-da44ca603225 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:42.187815 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c1cce511-29f7-4186-914d-da44ca603225 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:42.324612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c1cce511-29f7-4186-914d-da44ca603225 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:42.332757 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c1cce511-29f7-4186-914d-da44ca603225 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:42.334311 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c1cce511-29f7-4186-914d-da44ca603225 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:42.335468 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-c1cce511-29f7-4186-914d-da44ca603225 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.161884 Sep 14 01:09:42.336064 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 289/578] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:42 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:09:42.794248 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3cc43d01-4f52-41a1-816f-7b91e4847323 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:42.795003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3cc43d01-4f52-41a1-816f-7b91e4847323 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:42.800905 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3cc43d01-4f52-41a1-816f-7b91e4847323 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:42.801419 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3cc43d01-4f52-41a1-816f-7b91e4847323 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:42.801858 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3cc43d01-4f52-41a1-816f-7b91e4847323 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:42.802746 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3cc43d01-4f52-41a1-816f-7b91e4847323 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:42.803205 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3cc43d01-4f52-41a1-816f-7b91e4847323 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:42.803664 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3cc43d01-4f52-41a1-816f-7b91e4847323 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:42.939975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3cc43d01-4f52-41a1-816f-7b91e4847323 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:42.949551 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3cc43d01-4f52-41a1-816f-7b91e4847323 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1721 microversion: 2.1 time: 0.159131 Sep 14 01:09:42.950120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 290/579] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:42 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:43.172642 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-db27b635-31a1-437c-b831-7f1f3a291ed0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:43.173286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-db27b635-31a1-437c-b831-7f1f3a291ed0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:43.179793 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-db27b635-31a1-437c-b831-7f1f3a291ed0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:43.180380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-db27b635-31a1-437c-b831-7f1f3a291ed0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:43.180709 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-db27b635-31a1-437c-b831-7f1f3a291ed0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:43.181401 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-db27b635-31a1-437c-b831-7f1f3a291ed0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:43.181865 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-db27b635-31a1-437c-b831-7f1f3a291ed0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:43.182296 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-db27b635-31a1-437c-b831-7f1f3a291ed0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:43.313709 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-db27b635-31a1-437c-b831-7f1f3a291ed0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:43.319344 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=2 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:43.322308 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-db27b635-31a1-437c-b831-7f1f3a291ed0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1363 microversion: 2.1 time: 0.153554 Sep 14 01:09:43.322874 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 290/580] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:43 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:09:43.360434 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-97b14547-865c-4513-a9d6-9af15dcf42fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:43.361049 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-97b14547-865c-4513-a9d6-9af15dcf42fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:43.367469 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-97b14547-865c-4513-a9d6-9af15dcf42fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:43.367997 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-97b14547-865c-4513-a9d6-9af15dcf42fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:43.368431 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-97b14547-865c-4513-a9d6-9af15dcf42fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:43.369116 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-97b14547-865c-4513-a9d6-9af15dcf42fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:43.369572 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-97b14547-865c-4513-a9d6-9af15dcf42fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:43.370000 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-97b14547-865c-4513-a9d6-9af15dcf42fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:43.498665 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-97b14547-865c-4513-a9d6-9af15dcf42fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:43.506717 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-97b14547-865c-4513-a9d6-9af15dcf42fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:43.508213 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-97b14547-865c-4513-a9d6-9af15dcf42fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:43.509358 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-97b14547-865c-4513-a9d6-9af15dcf42fa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.152778 Sep 14 01:09:43.509918 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 291/581] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:43 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:09:43.973692 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9111c09c-1512-4846-af36-bceba1aa27e3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:43.974370 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9111c09c-1512-4846-af36-bceba1aa27e3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:43.976182 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=10 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:43.982003 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9111c09c-1512-4846-af36-bceba1aa27e3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:43.982490 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9111c09c-1512-4846-af36-bceba1aa27e3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:43.982928 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9111c09c-1512-4846-af36-bceba1aa27e3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:43.983656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9111c09c-1512-4846-af36-bceba1aa27e3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:43.984114 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9111c09c-1512-4846-af36-bceba1aa27e3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:43.984535 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9111c09c-1512-4846-af36-bceba1aa27e3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:44.123083 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9111c09c-1512-4846-af36-bceba1aa27e3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:44.131827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9111c09c-1512-4846-af36-bceba1aa27e3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1721 microversion: 2.1 time: 0.162350 Sep 14 01:09:44.132387 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 291/582] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:43 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:44.347159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8c239ab9-b251-4115-af2d-4ee0fee9538d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:44.347801 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8c239ab9-b251-4115-af2d-4ee0fee9538d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:44.349662 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:44.355469 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8c239ab9-b251-4115-af2d-4ee0fee9538d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:44.355983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8c239ab9-b251-4115-af2d-4ee0fee9538d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:44.356420 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8c239ab9-b251-4115-af2d-4ee0fee9538d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:44.357134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8c239ab9-b251-4115-af2d-4ee0fee9538d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:44.357586 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8c239ab9-b251-4115-af2d-4ee0fee9538d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:44.358008 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8c239ab9-b251-4115-af2d-4ee0fee9538d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:44.490237 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8c239ab9-b251-4115-af2d-4ee0fee9538d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:44.498110 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8c239ab9-b251-4115-af2d-4ee0fee9538d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1363 microversion: 2.1 time: 0.155427 Sep 14 01:09:44.498663 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 292/583] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:44 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:44.535381 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-602cfc4f-712c-44c5-a743-15db82affe3c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:44.536506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-602cfc4f-712c-44c5-a743-15db82affe3c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:44.543486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-602cfc4f-712c-44c5-a743-15db82affe3c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:44.544001 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-602cfc4f-712c-44c5-a743-15db82affe3c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:44.544443 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-602cfc4f-712c-44c5-a743-15db82affe3c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:44.545133 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-602cfc4f-712c-44c5-a743-15db82affe3c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:44.545593 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-602cfc4f-712c-44c5-a743-15db82affe3c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:44.546023 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-602cfc4f-712c-44c5-a743-15db82affe3c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:44.681718 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-602cfc4f-712c-44c5-a743-15db82affe3c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:44.689755 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-602cfc4f-712c-44c5-a743-15db82affe3c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:44.691203 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-602cfc4f-712c-44c5-a743-15db82affe3c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:44.692838 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-602cfc4f-712c-44c5-a743-15db82affe3c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.160976 Sep 14 01:09:44.693406 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 292/584] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:44 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:09:45.155289 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fe638568-0b2d-4252-ae16-a3bbfc6e171f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:45.155949 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fe638568-0b2d-4252-ae16-a3bbfc6e171f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:45.162540 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fe638568-0b2d-4252-ae16-a3bbfc6e171f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:45.163025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fe638568-0b2d-4252-ae16-a3bbfc6e171f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:45.163460 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fe638568-0b2d-4252-ae16-a3bbfc6e171f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:45.164172 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fe638568-0b2d-4252-ae16-a3bbfc6e171f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:45.164630 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fe638568-0b2d-4252-ae16-a3bbfc6e171f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:45.165054 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fe638568-0b2d-4252-ae16-a3bbfc6e171f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:45.293097 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fe638568-0b2d-4252-ae16-a3bbfc6e171f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:45.301200 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fe638568-0b2d-4252-ae16-a3bbfc6e171f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1721 microversion: 2.1 time: 0.149718 Sep 14 01:09:45.302313 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 293/585] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:45 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:45.524622 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-b0ec0877-0f30-4e1d-9e21-5fdfc295c5f0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:45.525830 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-b0ec0877-0f30-4e1d-9e21-5fdfc295c5f0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:45.532494 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b0ec0877-0f30-4e1d-9e21-5fdfc295c5f0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:45.533286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b0ec0877-0f30-4e1d-9e21-5fdfc295c5f0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:45.533889 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b0ec0877-0f30-4e1d-9e21-5fdfc295c5f0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:45.534822 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b0ec0877-0f30-4e1d-9e21-5fdfc295c5f0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:45.535366 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b0ec0877-0f30-4e1d-9e21-5fdfc295c5f0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:45.536521 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b0ec0877-0f30-4e1d-9e21-5fdfc295c5f0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:45.675266 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b0ec0877-0f30-4e1d-9e21-5fdfc295c5f0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:45.683648 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-b0ec0877-0f30-4e1d-9e21-5fdfc295c5f0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1363 microversion: 2.1 time: 0.164963 Sep 14 01:09:45.684212 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 293/586] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:45 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:09:45.718635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2a6739d0-dfa7-4721-99f9-58b4a0dcff0b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:45.719355 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2a6739d0-dfa7-4721-99f9-58b4a0dcff0b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:45.726492 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2a6739d0-dfa7-4721-99f9-58b4a0dcff0b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:45.727057 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2a6739d0-dfa7-4721-99f9-58b4a0dcff0b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:45.727582 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2a6739d0-dfa7-4721-99f9-58b4a0dcff0b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:45.728418 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2a6739d0-dfa7-4721-99f9-58b4a0dcff0b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:45.728942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2a6739d0-dfa7-4721-99f9-58b4a0dcff0b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:45.729431 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2a6739d0-dfa7-4721-99f9-58b4a0dcff0b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:45.858124 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2a6739d0-dfa7-4721-99f9-58b4a0dcff0b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:45.866634 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2a6739d0-dfa7-4721-99f9-58b4a0dcff0b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:45.868094 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2a6739d0-dfa7-4721-99f9-58b4a0dcff0b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:45.869240 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2a6739d0-dfa7-4721-99f9-58b4a0dcff0b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.154531 Sep 14 01:09:45.869787 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 294/587] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:45 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:09:46.299639 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-c94adc34-6d8b-43f0-9bf3-a0b15a077fae req-8ca5566c-c5cc-4cf1-acee-193cb32b97f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c7d241-afe4-4cee-a009-fa481d6abe5e", "name": "network-vif-plugged", "status": "completed", "tag": "11bcbd99-dcf9-4ee8-ae91-4d0de4546447"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:09:46.310185 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-c94adc34-6d8b-43f0-9bf3-a0b15a077fae req-8ca5566c-c5cc-4cf1-acee-193cb32b97f8 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:46.310752 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-c94adc34-6d8b-43f0-9bf3-a0b15a077fae req-8ca5566c-c5cc-4cf1-acee-193cb32b97f8 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:46.311118 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-c94adc34-6d8b-43f0-9bf3-a0b15a077fae req-8ca5566c-c5cc-4cf1-acee-193cb32b97f8 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:46.322399 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-c94adc34-6d8b-43f0-9bf3-a0b15a077fae req-8ca5566c-c5cc-4cf1-acee-193cb32b97f8 service nova] Creating event network-vif-plugged:11bcbd99-dcf9-4ee8-ae91-4d0de4546447 for instance 09c7d241-afe4-4cee-a009-fa481d6abe5e on hv-cinder-85752 Sep 14 01:09:46.325457 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4b1be41d-6c3f-4bcb-9f8e-4118a2d3fcde tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:46.326328 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4b1be41d-6c3f-4bcb-9f8e-4118a2d3fcde tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:46.327582 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-c94adc34-6d8b-43f0-9bf3-a0b15a077fae req-8ca5566c-c5cc-4cf1-acee-193cb32b97f8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031589 Sep 14 01:09:46.328589 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 294/588] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:09:46.333624 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b1be41d-6c3f-4bcb-9f8e-4118a2d3fcde tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:46.334116 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b1be41d-6c3f-4bcb-9f8e-4118a2d3fcde tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:46.334555 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b1be41d-6c3f-4bcb-9f8e-4118a2d3fcde tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:46.335261 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b1be41d-6c3f-4bcb-9f8e-4118a2d3fcde tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:46.335756 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b1be41d-6c3f-4bcb-9f8e-4118a2d3fcde tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:46.336218 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b1be41d-6c3f-4bcb-9f8e-4118a2d3fcde tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:46.467642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4b1be41d-6c3f-4bcb-9f8e-4118a2d3fcde tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:46.476646 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4b1be41d-6c3f-4bcb-9f8e-4118a2d3fcde tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1721 microversion: 2.1 time: 0.155408 Sep 14 01:09:46.478364 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 295/589] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:46 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:46.710227 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4e702e1d-914f-48f0-a8c8-93ba6771915f tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:46.710981 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4e702e1d-914f-48f0-a8c8-93ba6771915f tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:46.718664 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4e702e1d-914f-48f0-a8c8-93ba6771915f tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:46.719186 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4e702e1d-914f-48f0-a8c8-93ba6771915f tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:46.719787 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4e702e1d-914f-48f0-a8c8-93ba6771915f tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:46.720587 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4e702e1d-914f-48f0-a8c8-93ba6771915f tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:46.721182 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4e702e1d-914f-48f0-a8c8-93ba6771915f tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:46.721666 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4e702e1d-914f-48f0-a8c8-93ba6771915f tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:46.894554 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6dfa441b-122a-4f04-a31d-3c2c5072ecc7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:46.895162 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6dfa441b-122a-4f04-a31d-3c2c5072ecc7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:46.901789 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6dfa441b-122a-4f04-a31d-3c2c5072ecc7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:46.902285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6dfa441b-122a-4f04-a31d-3c2c5072ecc7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:46.902719 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6dfa441b-122a-4f04-a31d-3c2c5072ecc7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:46.903448 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6dfa441b-122a-4f04-a31d-3c2c5072ecc7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:46.903928 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6dfa441b-122a-4f04-a31d-3c2c5072ecc7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:46.904353 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6dfa441b-122a-4f04-a31d-3c2c5072ecc7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:47.043425 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6dfa441b-122a-4f04-a31d-3c2c5072ecc7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:47.052231 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6dfa441b-122a-4f04-a31d-3c2c5072ecc7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:47.053700 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6dfa441b-122a-4f04-a31d-3c2c5072ecc7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:47.054981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6dfa441b-122a-4f04-a31d-3c2c5072ecc7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1745 microversion: 2.20 time: 0.164433 Sep 14 01:09:47.055396 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 296/590] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:46 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:09:47.076207 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4e702e1d-914f-48f0-a8c8-93ba6771915f tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:47.084481 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4e702e1d-914f-48f0-a8c8-93ba6771915f tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1363 microversion: 2.1 time: 0.379933 Sep 14 01:09:47.085048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 295/591] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:46 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1363 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:47.501788 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b30d5e7e-09ee-4307-bcc5-0aab290d68e5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:47.502392 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b30d5e7e-09ee-4307-bcc5-0aab290d68e5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:47.504279 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:47.509383 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b30d5e7e-09ee-4307-bcc5-0aab290d68e5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:47.509865 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b30d5e7e-09ee-4307-bcc5-0aab290d68e5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:47.510299 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b30d5e7e-09ee-4307-bcc5-0aab290d68e5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:47.510983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b30d5e7e-09ee-4307-bcc5-0aab290d68e5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:47.511741 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b30d5e7e-09ee-4307-bcc5-0aab290d68e5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:47.512170 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b30d5e7e-09ee-4307-bcc5-0aab290d68e5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:47.869192 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b30d5e7e-09ee-4307-bcc5-0aab290d68e5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:47.877543 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b30d5e7e-09ee-4307-bcc5-0aab290d68e5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1721 microversion: 2.1 time: 0.380075 Sep 14 01:09:47.878119 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 297/592] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:47 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1721 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:09:48.083872 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-cf102beb-de7e-4467-9af1-d722680c9717 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:48.084482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-cf102beb-de7e-4467-9af1-d722680c9717 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:48.090882 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cf102beb-de7e-4467-9af1-d722680c9717 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:48.091401 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cf102beb-de7e-4467-9af1-d722680c9717 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:48.091879 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cf102beb-de7e-4467-9af1-d722680c9717 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:48.092577 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cf102beb-de7e-4467-9af1-d722680c9717 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:48.093040 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cf102beb-de7e-4467-9af1-d722680c9717 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:48.093464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cf102beb-de7e-4467-9af1-d722680c9717 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:48.106447 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-84e96cde-748e-4204-a06d-d86ecce976b2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:48.107062 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-84e96cde-748e-4204-a06d-d86ecce976b2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:48.113504 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84e96cde-748e-4204-a06d-d86ecce976b2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:48.114016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84e96cde-748e-4204-a06d-d86ecce976b2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:48.114449 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84e96cde-748e-4204-a06d-d86ecce976b2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:48.115137 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84e96cde-748e-4204-a06d-d86ecce976b2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:48.115638 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84e96cde-748e-4204-a06d-d86ecce976b2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:48.116071 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84e96cde-748e-4204-a06d-d86ecce976b2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:48.228893 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-cf102beb-de7e-4467-9af1-d722680c9717 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:48.237092 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-cf102beb-de7e-4467-9af1-d722680c9717 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:48.238595 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-cf102beb-de7e-4467-9af1-d722680c9717 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:48.239772 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-cf102beb-de7e-4467-9af1-d722680c9717 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1745 microversion: 2.20 time: 0.160350 Sep 14 01:09:48.240334 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 296/593] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:48 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:09:48.244264 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-84e96cde-748e-4204-a06d-d86ecce976b2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:48.252110 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-84e96cde-748e-4204-a06d-d86ecce976b2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1363 microversion: 2.1 time: 0.149789 Sep 14 01:09:48.252686 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 298/594] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:48 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:09:48.901577 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-45ee2fc4-e60c-4dbd-bf3c-33d135e0c2e9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:48.902107 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-45ee2fc4-e60c-4dbd-bf3c-33d135e0c2e9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:48.908014 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-45ee2fc4-e60c-4dbd-bf3c-33d135e0c2e9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:48.908529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-45ee2fc4-e60c-4dbd-bf3c-33d135e0c2e9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:48.909007 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-45ee2fc4-e60c-4dbd-bf3c-33d135e0c2e9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:48.909719 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-45ee2fc4-e60c-4dbd-bf3c-33d135e0c2e9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:48.910173 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-45ee2fc4-e60c-4dbd-bf3c-33d135e0c2e9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:48.911177 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-45ee2fc4-e60c-4dbd-bf3c-33d135e0c2e9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:49.044881 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-45ee2fc4-e60c-4dbd-bf3c-33d135e0c2e9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:49.053782 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-45ee2fc4-e60c-4dbd-bf3c-33d135e0c2e9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1721 microversion: 2.1 time: 0.155514 Sep 14 01:09:49.053782 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 297/595] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:48 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:49.265734 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c2524de9-734c-4f5a-a8ef-f566fae004a4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:49.266337 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c2524de9-734c-4f5a-a8ef-f566fae004a4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:49.273374 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2524de9-734c-4f5a-a8ef-f566fae004a4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:49.273858 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2524de9-734c-4f5a-a8ef-f566fae004a4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:49.274293 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2524de9-734c-4f5a-a8ef-f566fae004a4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:49.274981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2524de9-734c-4f5a-a8ef-f566fae004a4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:49.275434 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2524de9-734c-4f5a-a8ef-f566fae004a4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:49.275831 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-892c4b93-53a6-45bc-a214-22331f79d45d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:49.276233 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2524de9-734c-4f5a-a8ef-f566fae004a4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:49.276447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-892c4b93-53a6-45bc-a214-22331f79d45d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:49.282821 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-892c4b93-53a6-45bc-a214-22331f79d45d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:49.283312 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-892c4b93-53a6-45bc-a214-22331f79d45d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:49.283782 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-892c4b93-53a6-45bc-a214-22331f79d45d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:49.284473 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-892c4b93-53a6-45bc-a214-22331f79d45d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:49.284933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-892c4b93-53a6-45bc-a214-22331f79d45d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:49.285361 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-892c4b93-53a6-45bc-a214-22331f79d45d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:49.416607 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-892c4b93-53a6-45bc-a214-22331f79d45d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:49.421544 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c2524de9-734c-4f5a-a8ef-f566fae004a4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:49.424314 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-892c4b93-53a6-45bc-a214-22331f79d45d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1363 microversion: 2.1 time: 0.152388 Sep 14 01:09:49.424882 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 298/596] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:49 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:09:49.429701 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c2524de9-734c-4f5a-a8ef-f566fae004a4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:49.431165 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c2524de9-734c-4f5a-a8ef-f566fae004a4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:49.432330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c2524de9-734c-4f5a-a8ef-f566fae004a4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1745 microversion: 2.20 time: 0.170880 Sep 14 01:09:49.433071 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 299/597] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:49 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:09:50.076228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-90dcf7bb-cae4-4d99-9e95-0f9f52367453 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:50.076753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-90dcf7bb-cae4-4d99-9e95-0f9f52367453 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:50.083481 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-90dcf7bb-cae4-4d99-9e95-0f9f52367453 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:50.083991 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-90dcf7bb-cae4-4d99-9e95-0f9f52367453 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:50.084428 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-90dcf7bb-cae4-4d99-9e95-0f9f52367453 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:50.085115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-90dcf7bb-cae4-4d99-9e95-0f9f52367453 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:50.085569 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-90dcf7bb-cae4-4d99-9e95-0f9f52367453 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:50.085997 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-90dcf7bb-cae4-4d99-9e95-0f9f52367453 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:50.217300 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-90dcf7bb-cae4-4d99-9e95-0f9f52367453 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:50.225425 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-90dcf7bb-cae4-4d99-9e95-0f9f52367453 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1721 microversion: 2.1 time: 0.153126 Sep 14 01:09:50.225986 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 299/598] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:50 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:50.447175 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2f9c908a-5576-48e1-a34c-c4234d9c13cd tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:50.447823 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2f9c908a-5576-48e1-a34c-c4234d9c13cd tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:50.453832 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f9c908a-5576-48e1-a34c-c4234d9c13cd tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:50.454343 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f9c908a-5576-48e1-a34c-c4234d9c13cd tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:50.454776 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f9c908a-5576-48e1-a34c-c4234d9c13cd tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:50.455467 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f9c908a-5576-48e1-a34c-c4234d9c13cd tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:50.456437 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f9c908a-5576-48e1-a34c-c4234d9c13cd tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:50.456872 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f9c908a-5576-48e1-a34c-c4234d9c13cd tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:50.461440 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4d9bab15-054e-4901-b4be-b8f54f3d57a9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:50.462045 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4d9bab15-054e-4901-b4be-b8f54f3d57a9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:50.468382 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d9bab15-054e-4901-b4be-b8f54f3d57a9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:50.468875 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d9bab15-054e-4901-b4be-b8f54f3d57a9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:50.469338 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d9bab15-054e-4901-b4be-b8f54f3d57a9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:50.470027 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d9bab15-054e-4901-b4be-b8f54f3d57a9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:50.470478 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d9bab15-054e-4901-b4be-b8f54f3d57a9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:50.470895 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d9bab15-054e-4901-b4be-b8f54f3d57a9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:50.589943 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2f9c908a-5576-48e1-a34c-c4234d9c13cd tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:50.597572 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2f9c908a-5576-48e1-a34c-c4234d9c13cd tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1363 microversion: 2.1 time: 0.154419 Sep 14 01:09:50.598197 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 300/599] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:50 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:50.607786 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4d9bab15-054e-4901-b4be-b8f54f3d57a9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:50.616432 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4d9bab15-054e-4901-b4be-b8f54f3d57a9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:50.617904 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4d9bab15-054e-4901-b4be-b8f54f3d57a9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:50.619046 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4d9bab15-054e-4901-b4be-b8f54f3d57a9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1745 microversion: 2.20 time: 0.162447 Sep 14 01:09:50.619650 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 300/600] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:50 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:09:51.247820 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9de33245-0a60-45c3-b9ff-21911f5461e0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:51.248441 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9de33245-0a60-45c3-b9ff-21911f5461e0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:51.254435 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9de33245-0a60-45c3-b9ff-21911f5461e0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:51.254898 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9de33245-0a60-45c3-b9ff-21911f5461e0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:51.255328 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9de33245-0a60-45c3-b9ff-21911f5461e0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:51.256039 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9de33245-0a60-45c3-b9ff-21911f5461e0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:51.256507 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9de33245-0a60-45c3-b9ff-21911f5461e0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:51.256906 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9de33245-0a60-45c3-b9ff-21911f5461e0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:51.538641 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9de33245-0a60-45c3-b9ff-21911f5461e0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:51.546789 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9de33245-0a60-45c3-b9ff-21911f5461e0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1721 microversion: 2.1 time: 0.302965 Sep 14 01:09:51.547347 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 301/601] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:51 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1721 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:51.620408 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e334cf58-e239-47a3-83c1-a6a5d3d5b913 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:51.621037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-e334cf58-e239-47a3-83c1-a6a5d3d5b913 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:51.627350 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e334cf58-e239-47a3-83c1-a6a5d3d5b913 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:51.627859 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e334cf58-e239-47a3-83c1-a6a5d3d5b913 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:51.628295 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e334cf58-e239-47a3-83c1-a6a5d3d5b913 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:51.629498 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e334cf58-e239-47a3-83c1-a6a5d3d5b913 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:51.629947 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e334cf58-e239-47a3-83c1-a6a5d3d5b913 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:51.630372 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e334cf58-e239-47a3-83c1-a6a5d3d5b913 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:51.644716 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-58239dd3-ae69-4162-b7d1-35b6cfce7aa5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:51.646009 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-58239dd3-ae69-4162-b7d1-35b6cfce7aa5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:51.651824 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58239dd3-ae69-4162-b7d1-35b6cfce7aa5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:51.652307 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58239dd3-ae69-4162-b7d1-35b6cfce7aa5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:51.652734 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58239dd3-ae69-4162-b7d1-35b6cfce7aa5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:51.653411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58239dd3-ae69-4162-b7d1-35b6cfce7aa5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:51.653857 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58239dd3-ae69-4162-b7d1-35b6cfce7aa5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:51.654272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58239dd3-ae69-4162-b7d1-35b6cfce7aa5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:51.767545 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e334cf58-e239-47a3-83c1-a6a5d3d5b913 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:51.775937 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-e334cf58-e239-47a3-83c1-a6a5d3d5b913 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1363 microversion: 2.1 time: 0.159300 Sep 14 01:09:51.776506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 301/602] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:51 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:51.792491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-58239dd3-ae69-4162-b7d1-35b6cfce7aa5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:51.801369 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-58239dd3-ae69-4162-b7d1-35b6cfce7aa5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:51.802823 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-58239dd3-ae69-4162-b7d1-35b6cfce7aa5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:51.803996 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-58239dd3-ae69-4162-b7d1-35b6cfce7aa5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1745 microversion: 2.20 time: 0.163156 Sep 14 01:09:51.804828 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 302/603] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:51 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:09:52.570581 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-bac5b51a-c879-49d2-ba3d-aa0c339d6057 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:52.571527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-bac5b51a-c879-49d2-ba3d-aa0c339d6057 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:52.577885 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bac5b51a-c879-49d2-ba3d-aa0c339d6057 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:52.578366 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bac5b51a-c879-49d2-ba3d-aa0c339d6057 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:52.578798 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bac5b51a-c879-49d2-ba3d-aa0c339d6057 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:52.579478 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bac5b51a-c879-49d2-ba3d-aa0c339d6057 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:52.579949 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bac5b51a-c879-49d2-ba3d-aa0c339d6057 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:52.580367 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bac5b51a-c879-49d2-ba3d-aa0c339d6057 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:52.711848 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bac5b51a-c879-49d2-ba3d-aa0c339d6057 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:52.719879 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-bac5b51a-c879-49d2-ba3d-aa0c339d6057 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1721 microversion: 2.1 time: 0.154114 Sep 14 01:09:52.720443 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 302/604] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:52 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:52.797949 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-58be272a-8283-44e8-a258-69b2f10d05e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:52.798575 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-58be272a-8283-44e8-a258-69b2f10d05e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:52.804963 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58be272a-8283-44e8-a258-69b2f10d05e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:52.805446 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58be272a-8283-44e8-a258-69b2f10d05e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:52.805884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58be272a-8283-44e8-a258-69b2f10d05e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:52.806574 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58be272a-8283-44e8-a258-69b2f10d05e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:52.807038 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58be272a-8283-44e8-a258-69b2f10d05e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:52.807461 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-58be272a-8283-44e8-a258-69b2f10d05e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:52.830646 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-c66ea5a5-3e74-45ef-af99-da35a32cb1b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:52.831354 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-c66ea5a5-3e74-45ef-af99-da35a32cb1b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:52.838390 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c66ea5a5-3e74-45ef-af99-da35a32cb1b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:52.838954 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c66ea5a5-3e74-45ef-af99-da35a32cb1b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:52.839398 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c66ea5a5-3e74-45ef-af99-da35a32cb1b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:52.840222 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c66ea5a5-3e74-45ef-af99-da35a32cb1b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:52.840686 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c66ea5a5-3e74-45ef-af99-da35a32cb1b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:52.841109 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c66ea5a5-3e74-45ef-af99-da35a32cb1b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:52.846103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=100 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:52.974034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-58be272a-8283-44e8-a258-69b2f10d05e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:52.983789 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-58be272a-8283-44e8-a258-69b2f10d05e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1363 microversion: 2.1 time: 0.189504 Sep 14 01:09:52.984648 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 303/605] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:52 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:53.001940 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c66ea5a5-3e74-45ef-af99-da35a32cb1b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:53.010400 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c66ea5a5-3e74-45ef-af99-da35a32cb1b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:53.012139 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c66ea5a5-3e74-45ef-af99-da35a32cb1b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:53.013307 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-c66ea5a5-3e74-45ef-af99-da35a32cb1b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1745 microversion: 2.20 time: 0.186635 Sep 14 01:09:53.013928 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 303/606] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:52 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1745 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:09:53.257658 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-3ebc3bf6-2303-4f14-878f-8f45d9bf106d req-020e69fe-4fe7-484d-9b8c-085f1cb27fbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02da4a4-64f7-47c0-a48f-9cdb71f30df9", "name": "network-vif-plugged", "status": "completed", "tag": "61ac6a9d-d543-4896-a237-b3287bcd2644"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:09:53.269100 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-3ebc3bf6-2303-4f14-878f-8f45d9bf106d req-020e69fe-4fe7-484d-9b8c-085f1cb27fbb service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:53.269623 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-3ebc3bf6-2303-4f14-878f-8f45d9bf106d req-020e69fe-4fe7-484d-9b8c-085f1cb27fbb service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:53.270702 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-3ebc3bf6-2303-4f14-878f-8f45d9bf106d req-020e69fe-4fe7-484d-9b8c-085f1cb27fbb service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:53.283364 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-3ebc3bf6-2303-4f14-878f-8f45d9bf106d req-020e69fe-4fe7-484d-9b8c-085f1cb27fbb service nova] Creating event network-vif-plugged:61ac6a9d-d543-4896-a237-b3287bcd2644 for instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 on hv-cinder-85752 Sep 14 01:09:53.289965 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-3ebc3bf6-2303-4f14-878f-8f45d9bf106d req-020e69fe-4fe7-484d-9b8c-085f1cb27fbb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036647 Sep 14 01:09:53.290922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 304/607] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:09:53.743104 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9784b293-5394-4d90-a5ef-657075887ebf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:53.743710 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9784b293-5394-4d90-a5ef-657075887ebf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:53.750108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9784b293-5394-4d90-a5ef-657075887ebf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:53.750589 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9784b293-5394-4d90-a5ef-657075887ebf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:53.751019 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9784b293-5394-4d90-a5ef-657075887ebf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:53.751733 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9784b293-5394-4d90-a5ef-657075887ebf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:53.752184 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9784b293-5394-4d90-a5ef-657075887ebf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:53.752602 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9784b293-5394-4d90-a5ef-657075887ebf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:53.885026 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9784b293-5394-4d90-a5ef-657075887ebf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:53.893463 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9784b293-5394-4d90-a5ef-657075887ebf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1721 microversion: 2.1 time: 0.154387 Sep 14 01:09:53.894018 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 304/608] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:53 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:54.009028 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-799b3615-48db-400d-9e28-20bc2740d364 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:54.009755 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-799b3615-48db-400d-9e28-20bc2740d364 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:54.016102 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-799b3615-48db-400d-9e28-20bc2740d364 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:54.016584 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-799b3615-48db-400d-9e28-20bc2740d364 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:54.017016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-799b3615-48db-400d-9e28-20bc2740d364 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:54.017705 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-799b3615-48db-400d-9e28-20bc2740d364 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:54.018155 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-799b3615-48db-400d-9e28-20bc2740d364 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:54.018574 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-799b3615-48db-400d-9e28-20bc2740d364 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:54.038317 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0ad8adba-d855-4153-a495-1771f847169c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:54.038960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0ad8adba-d855-4153-a495-1771f847169c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:54.045108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0ad8adba-d855-4153-a495-1771f847169c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:54.045600 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0ad8adba-d855-4153-a495-1771f847169c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:54.046039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0ad8adba-d855-4153-a495-1771f847169c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:54.046741 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0ad8adba-d855-4153-a495-1771f847169c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:54.047228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0ad8adba-d855-4153-a495-1771f847169c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:54.047754 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0ad8adba-d855-4153-a495-1771f847169c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:54.150427 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-799b3615-48db-400d-9e28-20bc2740d364 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:54.158782 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-799b3615-48db-400d-9e28-20bc2740d364 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1363 microversion: 2.1 time: 0.155041 Sep 14 01:09:54.159344 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 305/609] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:54 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:54.183706 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0ad8adba-d855-4153-a495-1771f847169c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:54.192659 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0ad8adba-d855-4153-a495-1771f847169c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:54.194316 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0ad8adba-d855-4153-a495-1771f847169c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:54.195470 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0ad8adba-d855-4153-a495-1771f847169c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1745 microversion: 2.20 time: 0.161173 Sep 14 01:09:54.196047 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 305/610] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:54 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:09:54.918095 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-76412652-4fd0-4372-ab1a-df18377a21c3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:54.918714 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-76412652-4fd0-4372-ab1a-df18377a21c3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:54.924719 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-76412652-4fd0-4372-ab1a-df18377a21c3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:54.925205 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-76412652-4fd0-4372-ab1a-df18377a21c3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:54.925643 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-76412652-4fd0-4372-ab1a-df18377a21c3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:54.926938 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-76412652-4fd0-4372-ab1a-df18377a21c3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:54.927507 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-76412652-4fd0-4372-ab1a-df18377a21c3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:54.927962 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-76412652-4fd0-4372-ab1a-df18377a21c3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:55.055224 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-76412652-4fd0-4372-ab1a-df18377a21c3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:55.058774 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:09:55.064264 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-76412652-4fd0-4372-ab1a-df18377a21c3 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1721 microversion: 2.1 time: 0.150366 Sep 14 01:09:55.064828 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 306/611] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:54 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:55.221144 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e6b36e67-9c5f-4543-8495-1233170f412e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:55.221782 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e6b36e67-9c5f-4543-8495-1233170f412e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:55.228504 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e6b36e67-9c5f-4543-8495-1233170f412e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:55.229057 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e6b36e67-9c5f-4543-8495-1233170f412e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:55.229488 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e6b36e67-9c5f-4543-8495-1233170f412e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:55.230172 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e6b36e67-9c5f-4543-8495-1233170f412e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:55.230622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e6b36e67-9c5f-4543-8495-1233170f412e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:55.231099 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e6b36e67-9c5f-4543-8495-1233170f412e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:55.362292 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-1b829fb4-a02c-4deb-be6b-65961d2cd0aa tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:55.362914 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-1b829fb4-a02c-4deb-be6b-65961d2cd0aa tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:55.367847 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e6b36e67-9c5f-4543-8495-1233170f412e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:55.369057 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1b829fb4-a02c-4deb-be6b-65961d2cd0aa tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:55.369551 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1b829fb4-a02c-4deb-be6b-65961d2cd0aa tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:55.369997 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1b829fb4-a02c-4deb-be6b-65961d2cd0aa tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:55.370700 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1b829fb4-a02c-4deb-be6b-65961d2cd0aa tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:55.371160 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1b829fb4-a02c-4deb-be6b-65961d2cd0aa tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:55.371606 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1b829fb4-a02c-4deb-be6b-65961d2cd0aa tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:55.375873 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e6b36e67-9c5f-4543-8495-1233170f412e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:55.377328 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e6b36e67-9c5f-4543-8495-1233170f412e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:55.378478 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e6b36e67-9c5f-4543-8495-1233170f412e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1745 microversion: 2.20 time: 0.161572 Sep 14 01:09:55.379785 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 307/612] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:55 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:09:55.500278 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-1b829fb4-a02c-4deb-be6b-65961d2cd0aa tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:55.508334 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-1b829fb4-a02c-4deb-be6b-65961d2cd0aa tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1363 microversion: 2.1 time: 0.330950 Sep 14 01:09:55.508889 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 306/613] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:55 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:56.088227 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2258e67c-313b-4126-8767-c3259428962d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:56.088969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2258e67c-313b-4126-8767-c3259428962d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:56.095401 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2258e67c-313b-4126-8767-c3259428962d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:56.095915 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2258e67c-313b-4126-8767-c3259428962d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:56.096352 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2258e67c-313b-4126-8767-c3259428962d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:56.097225 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2258e67c-313b-4126-8767-c3259428962d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:56.098201 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2258e67c-313b-4126-8767-c3259428962d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:56.098658 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2258e67c-313b-4126-8767-c3259428962d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:56.228094 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2258e67c-313b-4126-8767-c3259428962d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:56.236307 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2258e67c-313b-4126-8767-c3259428962d tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1721 microversion: 2.1 time: 0.151991 Sep 14 01:09:56.236882 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 308/614] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:56 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:56.404318 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-78b4eb70-52d4-4bbd-8056-5dae2ade8f91 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:56.404876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-78b4eb70-52d4-4bbd-8056-5dae2ade8f91 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:56.412022 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-78b4eb70-52d4-4bbd-8056-5dae2ade8f91 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:56.412530 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-78b4eb70-52d4-4bbd-8056-5dae2ade8f91 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:56.412967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-78b4eb70-52d4-4bbd-8056-5dae2ade8f91 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:56.413681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-78b4eb70-52d4-4bbd-8056-5dae2ade8f91 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:56.414167 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-78b4eb70-52d4-4bbd-8056-5dae2ade8f91 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:56.414592 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-78b4eb70-52d4-4bbd-8056-5dae2ade8f91 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:56.532124 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-631565a7-0aa9-4dcf-97a6-a74e08983322 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:56.532765 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-631565a7-0aa9-4dcf-97a6-a74e08983322 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:56.539266 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-631565a7-0aa9-4dcf-97a6-a74e08983322 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:56.539783 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-631565a7-0aa9-4dcf-97a6-a74e08983322 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:56.540210 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-631565a7-0aa9-4dcf-97a6-a74e08983322 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:56.540897 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-631565a7-0aa9-4dcf-97a6-a74e08983322 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:56.541350 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-631565a7-0aa9-4dcf-97a6-a74e08983322 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:56.541773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-631565a7-0aa9-4dcf-97a6-a74e08983322 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:56.547712 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-78b4eb70-52d4-4bbd-8056-5dae2ade8f91 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:56.555900 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-78b4eb70-52d4-4bbd-8056-5dae2ade8f91 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:56.557344 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-78b4eb70-52d4-4bbd-8056-5dae2ade8f91 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:56.558517 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-78b4eb70-52d4-4bbd-8056-5dae2ade8f91 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1745 microversion: 2.20 time: 0.158166 Sep 14 01:09:56.559063 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 307/615] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:56 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:09:56.671578 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-631565a7-0aa9-4dcf-97a6-a74e08983322 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:56.679025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-631565a7-0aa9-4dcf-97a6-a74e08983322 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1363 microversion: 2.1 time: 0.150799 Sep 14 01:09:56.679608 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 309/616] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:56 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:09:57.260975 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-5ff74a65-b3f0-4197-b1e7-b46a9257283e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:57.261877 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-5ff74a65-b3f0-4197-b1e7-b46a9257283e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:57.267790 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5ff74a65-b3f0-4197-b1e7-b46a9257283e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:57.268282 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5ff74a65-b3f0-4197-b1e7-b46a9257283e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:57.268712 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5ff74a65-b3f0-4197-b1e7-b46a9257283e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:57.269480 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5ff74a65-b3f0-4197-b1e7-b46a9257283e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:57.270397 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5ff74a65-b3f0-4197-b1e7-b46a9257283e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:57.270828 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5ff74a65-b3f0-4197-b1e7-b46a9257283e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:57.399066 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-5ff74a65-b3f0-4197-b1e7-b46a9257283e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:57.407132 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-5ff74a65-b3f0-4197-b1e7-b46a9257283e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1721 microversion: 2.1 time: 0.149983 Sep 14 01:09:57.407715 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 308/617] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:57 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:57.584011 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-19ffe3b7-8a4a-4de9-90c5-cb3387666b81 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:57.584615 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-19ffe3b7-8a4a-4de9-90c5-cb3387666b81 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:57.591200 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-19ffe3b7-8a4a-4de9-90c5-cb3387666b81 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:57.591717 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-19ffe3b7-8a4a-4de9-90c5-cb3387666b81 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:57.592144 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-19ffe3b7-8a4a-4de9-90c5-cb3387666b81 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:57.592816 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-19ffe3b7-8a4a-4de9-90c5-cb3387666b81 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:57.593572 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-19ffe3b7-8a4a-4de9-90c5-cb3387666b81 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:57.593996 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-19ffe3b7-8a4a-4de9-90c5-cb3387666b81 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:57.701453 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a387f8eb-647b-4f78-a5ea-d8460c8818b3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:57.702172 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a387f8eb-647b-4f78-a5ea-d8460c8818b3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:57.709236 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a387f8eb-647b-4f78-a5ea-d8460c8818b3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:57.709725 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a387f8eb-647b-4f78-a5ea-d8460c8818b3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:57.710165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a387f8eb-647b-4f78-a5ea-d8460c8818b3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:57.710861 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a387f8eb-647b-4f78-a5ea-d8460c8818b3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:57.711316 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a387f8eb-647b-4f78-a5ea-d8460c8818b3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:57.711769 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a387f8eb-647b-4f78-a5ea-d8460c8818b3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:57.720156 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-19ffe3b7-8a4a-4de9-90c5-cb3387666b81 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:57.729208 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-19ffe3b7-8a4a-4de9-90c5-cb3387666b81 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:57.730661 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-19ffe3b7-8a4a-4de9-90c5-cb3387666b81 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:57.731844 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-19ffe3b7-8a4a-4de9-90c5-cb3387666b81 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1745 microversion: 2.20 time: 0.152156 Sep 14 01:09:57.732402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 310/618] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:57 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:09:57.842183 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a387f8eb-647b-4f78-a5ea-d8460c8818b3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:57.850496 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a387f8eb-647b-4f78-a5ea-d8460c8818b3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1363 microversion: 2.1 time: 0.152929 Sep 14 01:09:57.851052 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 309/619] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:57 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:09:58.430481 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2a5bb3b5-008c-434e-9392-8f02d5c82b11 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:58.431088 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2a5bb3b5-008c-434e-9392-8f02d5c82b11 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:58.437065 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2a5bb3b5-008c-434e-9392-8f02d5c82b11 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:58.437546 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2a5bb3b5-008c-434e-9392-8f02d5c82b11 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:58.437977 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2a5bb3b5-008c-434e-9392-8f02d5c82b11 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:58.438651 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2a5bb3b5-008c-434e-9392-8f02d5c82b11 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:58.439102 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2a5bb3b5-008c-434e-9392-8f02d5c82b11 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:58.439518 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2a5bb3b5-008c-434e-9392-8f02d5c82b11 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:58.573698 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2a5bb3b5-008c-434e-9392-8f02d5c82b11 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:58.581780 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2a5bb3b5-008c-434e-9392-8f02d5c82b11 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1721 microversion: 2.1 time: 0.155240 Sep 14 01:09:58.584691 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 311/620] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:58 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:09:58.758596 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-90ee4619-9c36-4789-b4c9-d01fba09169d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:58.759151 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-90ee4619-9c36-4789-b4c9-d01fba09169d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:58.765804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-90ee4619-9c36-4789-b4c9-d01fba09169d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:58.766291 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-90ee4619-9c36-4789-b4c9-d01fba09169d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:58.766729 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-90ee4619-9c36-4789-b4c9-d01fba09169d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:58.767414 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-90ee4619-9c36-4789-b4c9-d01fba09169d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:58.767898 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-90ee4619-9c36-4789-b4c9-d01fba09169d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:58.768323 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-90ee4619-9c36-4789-b4c9-d01fba09169d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:58.874422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4d386edc-b2b8-4030-81e9-3e837d7457fb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:58.875066 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4d386edc-b2b8-4030-81e9-3e837d7457fb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:58.882350 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d386edc-b2b8-4030-81e9-3e837d7457fb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:58.882839 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d386edc-b2b8-4030-81e9-3e837d7457fb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:58.883279 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d386edc-b2b8-4030-81e9-3e837d7457fb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:58.883997 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d386edc-b2b8-4030-81e9-3e837d7457fb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:58.884479 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d386edc-b2b8-4030-81e9-3e837d7457fb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:58.884904 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d386edc-b2b8-4030-81e9-3e837d7457fb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:58.897320 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-90ee4619-9c36-4789-b4c9-d01fba09169d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:58.905482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-90ee4619-9c36-4789-b4c9-d01fba09169d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:58.907077 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-90ee4619-9c36-4789-b4c9-d01fba09169d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:58.908262 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-90ee4619-9c36-4789-b4c9-d01fba09169d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1745 microversion: 2.20 time: 0.154312 Sep 14 01:09:58.908820 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 310/621] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:58 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:09:59.013207 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4d386edc-b2b8-4030-81e9-3e837d7457fb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:59.021064 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4d386edc-b2b8-4030-81e9-3e837d7457fb tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1363 microversion: 2.1 time: 0.150559 Sep 14 01:09:59.021637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 312/622] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:58 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:09:59.605254 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-b22ef487-8e51-4447-8043-ddd9cbf34f2c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:09:59.605794 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-b22ef487-8e51-4447-8043-ddd9cbf34f2c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:09:59.611838 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b22ef487-8e51-4447-8043-ddd9cbf34f2c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:59.612329 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b22ef487-8e51-4447-8043-ddd9cbf34f2c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:59.612777 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b22ef487-8e51-4447-8043-ddd9cbf34f2c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:59.613472 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b22ef487-8e51-4447-8043-ddd9cbf34f2c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:09:59.614018 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b22ef487-8e51-4447-8043-ddd9cbf34f2c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:09:59.614449 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b22ef487-8e51-4447-8043-ddd9cbf34f2c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:09:59.750295 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b22ef487-8e51-4447-8043-ddd9cbf34f2c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:09:59.758658 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-b22ef487-8e51-4447-8043-ddd9cbf34f2c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1721 microversion: 2.1 time: 0.157492 Sep 14 01:09:59.759238 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 311/623] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:09:59 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:10:00.044348 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-fdba60ff-aa54-4aaf-b6b7-2b2714b527f2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:00.044967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-fdba60ff-aa54-4aaf-b6b7-2b2714b527f2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:00.047680 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a7fff6bb-e627-440f-9d90-a50715648f4e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:00.048323 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a7fff6bb-e627-440f-9d90-a50715648f4e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:00.054569 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a7fff6bb-e627-440f-9d90-a50715648f4e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:00.054760 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fdba60ff-aa54-4aaf-b6b7-2b2714b527f2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:00.055061 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a7fff6bb-e627-440f-9d90-a50715648f4e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:00.055175 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fdba60ff-aa54-4aaf-b6b7-2b2714b527f2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:00.055496 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a7fff6bb-e627-440f-9d90-a50715648f4e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:00.055657 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fdba60ff-aa54-4aaf-b6b7-2b2714b527f2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:00.056244 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fdba60ff-aa54-4aaf-b6b7-2b2714b527f2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:00.056618 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a7fff6bb-e627-440f-9d90-a50715648f4e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:00.056723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fdba60ff-aa54-4aaf-b6b7-2b2714b527f2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:00.057080 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a7fff6bb-e627-440f-9d90-a50715648f4e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:00.057192 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fdba60ff-aa54-4aaf-b6b7-2b2714b527f2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:00.057505 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a7fff6bb-e627-440f-9d90-a50715648f4e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:00.201743 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-fdba60ff-aa54-4aaf-b6b7-2b2714b527f2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:00.205269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a7fff6bb-e627-440f-9d90-a50715648f4e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:00.210898 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-fdba60ff-aa54-4aaf-b6b7-2b2714b527f2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1553 microversion: 2.1 time: 0.170632 Sep 14 01:10:00.211479 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 312/624] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:10:00 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:10:00.214485 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a7fff6bb-e627-440f-9d90-a50715648f4e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:00.215959 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a7fff6bb-e627-440f-9d90-a50715648f4e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:00.217116 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a7fff6bb-e627-440f-9d90-a50715648f4e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1745 microversion: 2.20 time: 0.287305 Sep 14 01:10:00.217798 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 313/625] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:09:59 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1745 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:00.233495 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-25c348fe-be85-4f43-9266-55ebe9a969d8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:00.233987 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-25c348fe-be85-4f43-9266-55ebe9a969d8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:00.240061 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-25c348fe-be85-4f43-9266-55ebe9a969d8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:00.240538 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-25c348fe-be85-4f43-9266-55ebe9a969d8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:00.240967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-25c348fe-be85-4f43-9266-55ebe9a969d8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:00.241642 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-25c348fe-be85-4f43-9266-55ebe9a969d8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:00.242095 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-25c348fe-be85-4f43-9266-55ebe9a969d8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:00.242512 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-25c348fe-be85-4f43-9266-55ebe9a969d8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:00.317957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-25c348fe-be85-4f43-9266-55ebe9a969d8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088074 Sep 14 01:10:00.318571 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 313/626] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Sep 14 01:10:00 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:10:00.782901 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7672db9d-d8ef-4147-9882-31675d6c4900 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:00.783725 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7672db9d-d8ef-4147-9882-31675d6c4900 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:00.790356 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7672db9d-d8ef-4147-9882-31675d6c4900 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:00.790955 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7672db9d-d8ef-4147-9882-31675d6c4900 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:00.791401 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7672db9d-d8ef-4147-9882-31675d6c4900 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:00.792125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7672db9d-d8ef-4147-9882-31675d6c4900 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:00.792581 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7672db9d-d8ef-4147-9882-31675d6c4900 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:00.793007 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7672db9d-d8ef-4147-9882-31675d6c4900 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:00.930338 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7672db9d-d8ef-4147-9882-31675d6c4900 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:00.940460 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7672db9d-d8ef-4147-9882-31675d6c4900 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1698 microversion: 2.1 time: 0.162037 Sep 14 01:10:00.952602 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 314/627] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:10:00 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1698 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:10:00.964602 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-86199c70-dab3-45d1-b615-f88880a8fdbb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:10:00.970920 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-86199c70-dab3-45d1-b615-f88880a8fdbb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:00.971254 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-86199c70-dab3-45d1-b615-f88880a8fdbb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:00.972614 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-86199c70-dab3-45d1-b615-f88880a8fdbb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:01.039319 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-86199c70-dab3-45d1-b615-f88880a8fdbb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Going to try to start instance {{(pid=120620) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 14 01:10:01.086953 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-86199c70-dab3-45d1-b615-f88880a8fdbb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "POST /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32/action" status: 202 len: 0 microversion: 2.1 time: 0.125954 Sep 14 01:10:01.087738 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 314/628] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 01:10:00 2022] POST /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:10:01.095458 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-47f05cd5-8cb3-4719-a8a3-d4d54b818c93 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:01.096228 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-47f05cd5-8cb3-4719-a8a3-d4d54b818c93 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:01.104065 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47f05cd5-8cb3-4719-a8a3-d4d54b818c93 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:01.104645 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47f05cd5-8cb3-4719-a8a3-d4d54b818c93 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:01.105048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47f05cd5-8cb3-4719-a8a3-d4d54b818c93 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:01.105987 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47f05cd5-8cb3-4719-a8a3-d4d54b818c93 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:01.106516 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47f05cd5-8cb3-4719-a8a3-d4d54b818c93 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:01.106894 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-47f05cd5-8cb3-4719-a8a3-d4d54b818c93 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:01.250380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7bcf756a-7649-4ffa-8020-dc6ff7632580 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:01.251247 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7bcf756a-7649-4ffa-8020-dc6ff7632580 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:01.271163 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7bcf756a-7649-4ffa-8020-dc6ff7632580 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:01.272234 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7bcf756a-7649-4ffa-8020-dc6ff7632580 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:01.272750 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7bcf756a-7649-4ffa-8020-dc6ff7632580 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:01.273629 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7bcf756a-7649-4ffa-8020-dc6ff7632580 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:01.274189 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7bcf756a-7649-4ffa-8020-dc6ff7632580 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:01.274688 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7bcf756a-7649-4ffa-8020-dc6ff7632580 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:01.278318 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-47f05cd5-8cb3-4719-a8a3-d4d54b818c93 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:01.297797 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-47f05cd5-8cb3-4719-a8a3-d4d54b818c93 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1707 microversion: 2.1 time: 0.206010 Sep 14 01:10:01.298782 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 315/629] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:10:01 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1707 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:10:01.340652 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-1e358749-c477-4cd7-9128-6c4e89a7b585 req-0a785537-f438-4405-83dd-c5776b6e3de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09c7d241-afe4-4cee-a009-fa481d6abe5e", "tag": "11bcbd99-dcf9-4ee8-ae91-4d0de4546447"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:10:01.355591 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-1e358749-c477-4cd7-9128-6c4e89a7b585 req-0a785537-f438-4405-83dd-c5776b6e3de2 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:01.356352 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-1e358749-c477-4cd7-9128-6c4e89a7b585 req-0a785537-f438-4405-83dd-c5776b6e3de2 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:01.357270 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-1e358749-c477-4cd7-9128-6c4e89a7b585 req-0a785537-f438-4405-83dd-c5776b6e3de2 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:01.372888 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-1e358749-c477-4cd7-9128-6c4e89a7b585 req-0a785537-f438-4405-83dd-c5776b6e3de2 service nova] Creating event network-changed:11bcbd99-dcf9-4ee8-ae91-4d0de4546447 for instance 09c7d241-afe4-4cee-a009-fa481d6abe5e on hv-cinder-85752 Sep 14 01:10:01.380254 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-1e358749-c477-4cd7-9128-6c4e89a7b585 req-0a785537-f438-4405-83dd-c5776b6e3de2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042729 Sep 14 01:10:01.380842 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 316/630] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:10:01.448347 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7bcf756a-7649-4ffa-8020-dc6ff7632580 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:01.458256 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7bcf756a-7649-4ffa-8020-dc6ff7632580 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:01.459856 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7bcf756a-7649-4ffa-8020-dc6ff7632580 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:01.461030 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7bcf756a-7649-4ffa-8020-dc6ff7632580 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1745 microversion: 2.20 time: 0.215328 Sep 14 01:10:01.461586 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 315/631] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:01 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1745 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:02.323694 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-563548d0-d2f1-4c48-8410-7c65333a491a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:02.325067 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-563548d0-d2f1-4c48-8410-7c65333a491a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:02.338652 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-563548d0-d2f1-4c48-8410-7c65333a491a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:02.343432 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-563548d0-d2f1-4c48-8410-7c65333a491a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:02.343920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-563548d0-d2f1-4c48-8410-7c65333a491a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:02.344652 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-563548d0-d2f1-4c48-8410-7c65333a491a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:02.345181 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-563548d0-d2f1-4c48-8410-7c65333a491a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:02.345847 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-563548d0-d2f1-4c48-8410-7c65333a491a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:02.487278 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e91099ee-d431-4d49-928d-727ba8ea253a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:02.488751 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-e91099ee-d431-4d49-928d-727ba8ea253a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:02.498114 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e91099ee-d431-4d49-928d-727ba8ea253a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:02.505511 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e91099ee-d431-4d49-928d-727ba8ea253a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:02.505994 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e91099ee-d431-4d49-928d-727ba8ea253a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:02.506738 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e91099ee-d431-4d49-928d-727ba8ea253a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:02.507214 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e91099ee-d431-4d49-928d-727ba8ea253a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:02.507665 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e91099ee-d431-4d49-928d-727ba8ea253a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:02.551817 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-563548d0-d2f1-4c48-8410-7c65333a491a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:02.560098 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-563548d0-d2f1-4c48-8410-7c65333a491a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1707 microversion: 2.1 time: 0.241880 Sep 14 01:10:02.560919 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 317/632] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:10:02 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1707 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:10:02.650163 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e91099ee-d431-4d49-928d-727ba8ea253a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:02.659646 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e91099ee-d431-4d49-928d-727ba8ea253a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:02.661210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e91099ee-d431-4d49-928d-727ba8ea253a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:02.662352 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-e91099ee-d431-4d49-928d-727ba8ea253a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1740 microversion: 2.20 time: 0.180466 Sep 14 01:10:02.662903 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 316/633] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:02 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:03.585547 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4d349358-865c-45d2-8d6f-c481425fc173 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:03.586162 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4d349358-865c-45d2-8d6f-c481425fc173 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:03.593222 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d349358-865c-45d2-8d6f-c481425fc173 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:03.593954 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d349358-865c-45d2-8d6f-c481425fc173 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:03.594407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d349358-865c-45d2-8d6f-c481425fc173 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:03.595119 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d349358-865c-45d2-8d6f-c481425fc173 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:03.595653 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d349358-865c-45d2-8d6f-c481425fc173 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:03.596025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d349358-865c-45d2-8d6f-c481425fc173 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:03.688302 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ddb68a38-8edb-4aaf-85a3-d56b894c1989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:03.689732 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ddb68a38-8edb-4aaf-85a3-d56b894c1989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:03.698463 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ddb68a38-8edb-4aaf-85a3-d56b894c1989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:03.698463 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ddb68a38-8edb-4aaf-85a3-d56b894c1989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:03.698971 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ddb68a38-8edb-4aaf-85a3-d56b894c1989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:03.700093 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ddb68a38-8edb-4aaf-85a3-d56b894c1989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:03.700558 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ddb68a38-8edb-4aaf-85a3-d56b894c1989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:03.700983 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ddb68a38-8edb-4aaf-85a3-d56b894c1989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:03.769446 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4d349358-865c-45d2-8d6f-c481425fc173 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:03.778552 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4d349358-865c-45d2-8d6f-c481425fc173 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1711 microversion: 2.1 time: 0.197835 Sep 14 01:10:03.779124 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 318/634] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:10:03 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1711 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:10:03.856019 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ddb68a38-8edb-4aaf-85a3-d56b894c1989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:03.868920 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ddb68a38-8edb-4aaf-85a3-d56b894c1989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:03.873722 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ddb68a38-8edb-4aaf-85a3-d56b894c1989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:03.876021 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ddb68a38-8edb-4aaf-85a3-d56b894c1989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1740 microversion: 2.20 time: 0.191655 Sep 14 01:10:03.876813 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 317/635] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:03 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:04.687944 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-95aba484-9271-4927-8b9c-fbb228adfdb8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:04.688476 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-95aba484-9271-4927-8b9c-fbb228adfdb8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:04.695414 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-95aba484-9271-4927-8b9c-fbb228adfdb8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:04.696064 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-95aba484-9271-4927-8b9c-fbb228adfdb8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:04.696645 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-95aba484-9271-4927-8b9c-fbb228adfdb8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:04.697625 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-95aba484-9271-4927-8b9c-fbb228adfdb8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:04.698183 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-95aba484-9271-4927-8b9c-fbb228adfdb8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:04.698713 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-95aba484-9271-4927-8b9c-fbb228adfdb8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:04.859315 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-95aba484-9271-4927-8b9c-fbb228adfdb8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lazy-loading 'services' on Instance uuid 41efe3bb-948d-49f2-974e-c1d3b846b8a8 {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:10:04.903066 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8535e1f2-28e9-4d11-acd6-a813085d2b89 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:04.904475 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8535e1f2-28e9-4d11-acd6-a813085d2b89 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:04.911866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=78 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:04.913974 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8535e1f2-28e9-4d11-acd6-a813085d2b89 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:04.914852 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8535e1f2-28e9-4d11-acd6-a813085d2b89 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:04.915531 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8535e1f2-28e9-4d11-acd6-a813085d2b89 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:04.916578 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8535e1f2-28e9-4d11-acd6-a813085d2b89 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:04.917250 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8535e1f2-28e9-4d11-acd6-a813085d2b89 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:04.918052 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8535e1f2-28e9-4d11-acd6-a813085d2b89 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:04.996245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-95aba484-9271-4927-8b9c-fbb228adfdb8 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "DELETE /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8/os-volume_attachments/e706b2aa-470d-4396-ba13-c316a5f5fdde" status: 202 len: 0 microversion: 2.1 time: 0.312464 Sep 14 01:10:04.996999 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 319/636] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 01:10:04 2022] DELETE /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8/os-volume_attachments/e706b2aa-470d-4396-ba13-c316a5f5fdde => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:10:05.119133 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8535e1f2-28e9-4d11-acd6-a813085d2b89 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:05.131727 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8535e1f2-28e9-4d11-acd6-a813085d2b89 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:05.134882 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8535e1f2-28e9-4d11-acd6-a813085d2b89 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:05.137501 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8535e1f2-28e9-4d11-acd6-a813085d2b89 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1740 microversion: 2.20 time: 0.239129 Sep 14 01:10:05.138562 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 318/637] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:04 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:06.171235 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-28492657-624e-4b7f-876b-b572db10dceb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:06.171235 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-28492657-624e-4b7f-876b-b572db10dceb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:06.180829 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28492657-624e-4b7f-876b-b572db10dceb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:06.180829 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28492657-624e-4b7f-876b-b572db10dceb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:06.180829 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28492657-624e-4b7f-876b-b572db10dceb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:06.180829 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28492657-624e-4b7f-876b-b572db10dceb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:06.181188 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28492657-624e-4b7f-876b-b572db10dceb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:06.181188 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-28492657-624e-4b7f-876b-b572db10dceb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:06.326410 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-28492657-624e-4b7f-876b-b572db10dceb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:06.336489 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-28492657-624e-4b7f-876b-b572db10dceb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:06.338456 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-28492657-624e-4b7f-876b-b572db10dceb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:06.339711 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-28492657-624e-4b7f-876b-b572db10dceb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1740 microversion: 2.20 time: 0.178964 Sep 14 01:10:06.340782 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 320/638] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:06 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:07.201050 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ac2ece08-1ae5-4de3-9838-0e9ffe1a4f39 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:07.202300 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ac2ece08-1ae5-4de3-9838-0e9ffe1a4f39 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:07.210116 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac2ece08-1ae5-4de3-9838-0e9ffe1a4f39 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:07.210624 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac2ece08-1ae5-4de3-9838-0e9ffe1a4f39 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:07.211057 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac2ece08-1ae5-4de3-9838-0e9ffe1a4f39 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:07.211771 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac2ece08-1ae5-4de3-9838-0e9ffe1a4f39 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:07.212221 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac2ece08-1ae5-4de3-9838-0e9ffe1a4f39 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:07.212644 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac2ece08-1ae5-4de3-9838-0e9ffe1a4f39 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:07.216927 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:07.244905 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ac2ece08-1ae5-4de3-9838-0e9ffe1a4f39 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Going to try to terminate instance {{(pid=120620) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:10:07.329644 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ac2ece08-1ae5-4de3-9838-0e9ffe1a4f39 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "DELETE /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 204 len: 0 microversion: 2.1 time: 0.132322 Sep 14 01:10:07.330305 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 319/639] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:10:07 2022] DELETE /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 01:10:07.338932 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b820060f-8ed2-4939-82a9-1d0f98d7bb7f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:07.339570 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b820060f-8ed2-4939-82a9-1d0f98d7bb7f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:07.346498 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b820060f-8ed2-4939-82a9-1d0f98d7bb7f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:07.347942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b820060f-8ed2-4939-82a9-1d0f98d7bb7f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:07.348850 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b820060f-8ed2-4939-82a9-1d0f98d7bb7f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:07.349683 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b820060f-8ed2-4939-82a9-1d0f98d7bb7f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:07.350168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b820060f-8ed2-4939-82a9-1d0f98d7bb7f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:07.350783 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b820060f-8ed2-4939-82a9-1d0f98d7bb7f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:07.366822 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-24cfb284-c76e-4df2-8b1f-050d70c78396 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:07.367549 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-24cfb284-c76e-4df2-8b1f-050d70c78396 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:07.379493 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-24cfb284-c76e-4df2-8b1f-050d70c78396 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:07.380031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-24cfb284-c76e-4df2-8b1f-050d70c78396 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:07.380482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-24cfb284-c76e-4df2-8b1f-050d70c78396 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:07.381194 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-24cfb284-c76e-4df2-8b1f-050d70c78396 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:07.381660 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-24cfb284-c76e-4df2-8b1f-050d70c78396 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:07.382099 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-24cfb284-c76e-4df2-8b1f-050d70c78396 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:07.561794 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b820060f-8ed2-4939-82a9-1d0f98d7bb7f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:07.572800 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b820060f-8ed2-4939-82a9-1d0f98d7bb7f tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1512 microversion: 2.1 time: 0.237543 Sep 14 01:10:07.575378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 321/640] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:10:07 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1512 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:10:07.766623 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-24cfb284-c76e-4df2-8b1f-050d70c78396 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:07.775864 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-24cfb284-c76e-4df2-8b1f-050d70c78396 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:07.777378 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-24cfb284-c76e-4df2-8b1f-050d70c78396 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:07.778548 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-24cfb284-c76e-4df2-8b1f-050d70c78396 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1740 microversion: 2.20 time: 0.416636 Sep 14 01:10:07.779290 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 320/641] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:07 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1740 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:10:08.600729 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-11ddd176-2e3e-499a-892c-006170ad5b39 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:08.601661 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-11ddd176-2e3e-499a-892c-006170ad5b39 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:08.619125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11ddd176-2e3e-499a-892c-006170ad5b39 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:08.619762 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11ddd176-2e3e-499a-892c-006170ad5b39 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:08.620279 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11ddd176-2e3e-499a-892c-006170ad5b39 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:08.621062 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11ddd176-2e3e-499a-892c-006170ad5b39 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:08.621592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11ddd176-2e3e-499a-892c-006170ad5b39 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:08.622072 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11ddd176-2e3e-499a-892c-006170ad5b39 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:08.775858 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-11ddd176-2e3e-499a-892c-006170ad5b39 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:08.783998 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-11ddd176-2e3e-499a-892c-006170ad5b39 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1512 microversion: 2.1 time: 0.188888 Sep 14 01:10:08.797051 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 322/642] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:10:08 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1512 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:10:08.805611 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-853fc419-89e7-4d5f-9151-e06db90e75d5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:08.806318 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-853fc419-89e7-4d5f-9151-e06db90e75d5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:08.814882 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-853fc419-89e7-4d5f-9151-e06db90e75d5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:08.816814 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-853fc419-89e7-4d5f-9151-e06db90e75d5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:08.817188 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-853fc419-89e7-4d5f-9151-e06db90e75d5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:08.818348 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-853fc419-89e7-4d5f-9151-e06db90e75d5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:08.819002 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-853fc419-89e7-4d5f-9151-e06db90e75d5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:08.820157 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-853fc419-89e7-4d5f-9151-e06db90e75d5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:08.970781 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-853fc419-89e7-4d5f-9151-e06db90e75d5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:08.980318 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-853fc419-89e7-4d5f-9151-e06db90e75d5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:08.981799 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-853fc419-89e7-4d5f-9151-e06db90e75d5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:08.983086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-853fc419-89e7-4d5f-9151-e06db90e75d5 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1740 microversion: 2.20 time: 0.181508 Sep 14 01:10:08.984144 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 321/643] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:08 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:10:09.807248 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-06d86083-058c-4a59-ac8b-1e15f3b96956 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:09.807985 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-06d86083-058c-4a59-ac8b-1e15f3b96956 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:09.814179 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-06d86083-058c-4a59-ac8b-1e15f3b96956 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:09.814673 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-06d86083-058c-4a59-ac8b-1e15f3b96956 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:09.815155 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-06d86083-058c-4a59-ac8b-1e15f3b96956 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:09.818744 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-06d86083-058c-4a59-ac8b-1e15f3b96956 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:09.819221 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-06d86083-058c-4a59-ac8b-1e15f3b96956 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:09.819684 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-06d86083-058c-4a59-ac8b-1e15f3b96956 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:09.851155 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:09.987588 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-06d86083-058c-4a59-ac8b-1e15f3b96956 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:09.996834 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-06d86083-058c-4a59-ac8b-1e15f3b96956 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1512 microversion: 2.1 time: 0.193534 Sep 14 01:10:09.997410 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 323/644] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:10:09 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1512 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:10:10.008684 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4d7e2ba3-36bf-477a-b491-545f229f1a3a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:10.009382 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4d7e2ba3-36bf-477a-b491-545f229f1a3a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:10.016549 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d7e2ba3-36bf-477a-b491-545f229f1a3a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:10.017046 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d7e2ba3-36bf-477a-b491-545f229f1a3a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:10.017488 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d7e2ba3-36bf-477a-b491-545f229f1a3a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:10.018191 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d7e2ba3-36bf-477a-b491-545f229f1a3a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:10.018649 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d7e2ba3-36bf-477a-b491-545f229f1a3a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:10.019654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4d7e2ba3-36bf-477a-b491-545f229f1a3a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:10.173730 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4d7e2ba3-36bf-477a-b491-545f229f1a3a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:10.185861 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4d7e2ba3-36bf-477a-b491-545f229f1a3a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:10.187322 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4d7e2ba3-36bf-477a-b491-545f229f1a3a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:10.188688 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4d7e2ba3-36bf-477a-b491-545f229f1a3a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1740 microversion: 2.20 time: 0.183818 Sep 14 01:10:10.189478 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 322/645] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:10 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:10.798868 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-fdbf5b67-339b-4d2a-8b6f-cf4f58f395da req-ecd4b6b8-f2de-4dfc-9994-6f87e44536fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41efe3bb-948d-49f2-974e-c1d3b846b8a8", "name": "network-vif-deleted", "tag": "775a97ae-c50c-4753-9069-80eb4c6633cf"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:10:10.814537 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-fdbf5b67-339b-4d2a-8b6f-cf4f58f395da req-ecd4b6b8-f2de-4dfc-9994-6f87e44536fc service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:10.815350 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-fdbf5b67-339b-4d2a-8b6f-cf4f58f395da req-ecd4b6b8-f2de-4dfc-9994-6f87e44536fc service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:10.816182 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-fdbf5b67-339b-4d2a-8b6f-cf4f58f395da req-ecd4b6b8-f2de-4dfc-9994-6f87e44536fc service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:10.832724 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-fdbf5b67-339b-4d2a-8b6f-cf4f58f395da req-ecd4b6b8-f2de-4dfc-9994-6f87e44536fc service nova] Creating event network-vif-deleted:775a97ae-c50c-4753-9069-80eb4c6633cf for instance 41efe3bb-948d-49f2-974e-c1d3b846b8a8 on hv-cinder-85752 Sep 14 01:10:10.837647 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-fdbf5b67-339b-4d2a-8b6f-cf4f58f395da req-ecd4b6b8-f2de-4dfc-9994-6f87e44536fc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042677 Sep 14 01:10:10.838327 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 324/646] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:10:11.025290 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-cbe2d98f-c87c-4cac-b4b2-e854f5292323 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:11.027414 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-cbe2d98f-c87c-4cac-b4b2-e854f5292323 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:11.035398 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cbe2d98f-c87c-4cac-b4b2-e854f5292323 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:11.036264 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cbe2d98f-c87c-4cac-b4b2-e854f5292323 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:11.037080 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cbe2d98f-c87c-4cac-b4b2-e854f5292323 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:11.038154 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cbe2d98f-c87c-4cac-b4b2-e854f5292323 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:11.038810 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cbe2d98f-c87c-4cac-b4b2-e854f5292323 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:11.039491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cbe2d98f-c87c-4cac-b4b2-e854f5292323 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:11.088836 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cbe2d98f-c87c-4cac-b4b2-e854f5292323 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:11.089271 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cbe2d98f-c87c-4cac-b4b2-e854f5292323 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:11.089861 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cbe2d98f-c87c-4cac-b4b2-e854f5292323 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:11.090095 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-cbe2d98f-c87c-4cac-b4b2-e854f5292323 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lazy-loading 'fault' on Instance uuid 41efe3bb-948d-49f2-974e-c1d3b846b8a8 {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:10:11.136605 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-cbe2d98f-c87c-4cac-b4b2-e854f5292323 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9c17d96f3d44589cee145c8ec2e97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eb4de1820448eb1064b0fbb45a259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:11.148433 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-cbe2d98f-c87c-4cac-b4b2-e854f5292323 tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 200 len: 1309 microversion: 2.1 time: 0.127563 Sep 14 01:10:11.163573 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 323/647] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:10:11 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 1309 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:10:11.222564 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d137f930-f7a0-4f59-b30f-ee45c34ae775 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:11.228500 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d137f930-f7a0-4f59-b30f-ee45c34ae775 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:11.239915 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d137f930-f7a0-4f59-b30f-ee45c34ae775 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:11.240671 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d137f930-f7a0-4f59-b30f-ee45c34ae775 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:11.241258 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d137f930-f7a0-4f59-b30f-ee45c34ae775 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:11.243027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d137f930-f7a0-4f59-b30f-ee45c34ae775 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:11.243517 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d137f930-f7a0-4f59-b30f-ee45c34ae775 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:11.243981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d137f930-f7a0-4f59-b30f-ee45c34ae775 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:11.420657 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d137f930-f7a0-4f59-b30f-ee45c34ae775 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:11.429732 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d137f930-f7a0-4f59-b30f-ee45c34ae775 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:11.431417 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d137f930-f7a0-4f59-b30f-ee45c34ae775 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:11.432941 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d137f930-f7a0-4f59-b30f-ee45c34ae775 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1740 microversion: 2.20 time: 0.221270 Sep 14 01:10:11.433810 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 325/648] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:11 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:12.179973 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-661c2634-7aa1-4a43-bf07-6afbea47762c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:12.180701 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-661c2634-7aa1-4a43-bf07-6afbea47762c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] [instance: 41efe3bb-948d-49f2-974e-c1d3b846b8a8] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:12.187766 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-661c2634-7aa1-4a43-bf07-6afbea47762c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:12.189248 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-661c2634-7aa1-4a43-bf07-6afbea47762c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:12.189981 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-661c2634-7aa1-4a43-bf07-6afbea47762c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:12.190702 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-661c2634-7aa1-4a43-bf07-6afbea47762c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:12.191158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-661c2634-7aa1-4a43-bf07-6afbea47762c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:12.192331 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-661c2634-7aa1-4a43-bf07-6afbea47762c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:12.213139 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-661c2634-7aa1-4a43-bf07-6afbea47762c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] HTTP exception thrown: Instance 41efe3bb-948d-49f2-974e-c1d3b846b8a8 could not be found. Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-661c2634-7aa1-4a43-bf07-6afbea47762c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Request method failure captured: Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 HTTP/1.1 Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISkh_6E9az3wywkVPrUXZH9Gl-DMT6gXnua5-IzuE60YJIb9ZxPYiaTJTwXbAkZUIfN1ucKfYM-TcJcgxN2AmHRg14aD7jcV8RczjQ6W7bj0GlyjK-TAZAJ0m5oZOZhDkKdfyAlswAI7s7rR2D_shWBBwagy9i9crSStczXXr6WAGOk Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 0f8eb4de1820448eb1064b0fbb45a259 Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-VolumesSnapshotTestJSON-190046587 Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:10:12.215056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:10:12.216563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0f8eb4de1820448eb1064b0fbb45a259"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0f8eb4de1820448eb1064b0fbb45a259"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0f8eb4de1820448eb1064b0fbb45a259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0f8eb4de1820448eb1064b0fbb45a259"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:10:12.216563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-VolumesSnapshotTestJSON-190046587 Sep 14 01:10:12.216563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 0f8eb4de1820448eb1064b0fbb45a259 Sep 14 01:10:12.216563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-190046587 Sep 14 01:10:12.216563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-VolumesSnapshotTestJSON-190046587-project Sep 14 01:10:12.216563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:10:12.216563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:10:12.216563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: 0b9c17d96f3d44589cee145c8ec2e97d Sep 14 01:10:12.216563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-VolumesSnapshotTestJSON-190046587-project Sep 14 01:10:12.216563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:10:12.216563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance 41efe3bb-948d-49f2-974e-c1d3b846b8a8 could not be found. Sep 14 01:10:12.216563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': '41efe3bb-948d-49f2-974e-c1d3b846b8a8'} Sep 14 01:10:12.217486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:10:12.217486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:10:12.217486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:10:12.217486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:10:12.217486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:10:12.217486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:10:12.217486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:10:12.217486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:10:12.217486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:10:12.217486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:10:12.217486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41efe3bb-948d-49f2-974e-c1d3b846b8a8 could not be found. Sep 14 01:10:12.217486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:10:12.217486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:10:12.217486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:10:12.217486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:10:12.217486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:10:12.217486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:10:12.217486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:10:12.217486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:10:12.217486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:10:12.218967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:10:12.218967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:10:12.218967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:10:12.218967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:10:12.218967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:10:12.218967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:10:12.218967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:10:12.218967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41efe3bb-948d-49f2-974e-c1d3b846b8a8 could not be found. Sep 14 01:10:12.218967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:10:12.218967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:10:12.218967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:10:12.218967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:10:12.218967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:10:12.218967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:10:12.218967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:10:12.218967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:10:12.218967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41efe3bb-948d-49f2-974e-c1d3b846b8a8 could not be found. Sep 14 01:10:12.218967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:10:12.220204 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-661c2634-7aa1-4a43-bf07-6afbea47762c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] Returning 404 to user: Instance 41efe3bb-948d-49f2-974e-c1d3b846b8a8 could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:10:12.220204 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-661c2634-7aa1-4a43-bf07-6afbea47762c tempest-VolumesSnapshotTestJSON-190046587 tempest-VolumesSnapshotTestJSON-190046587-project] 10.222.0.42 "GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8" status: 404 len: 111 microversion: 2.1 time: 0.042533 Sep 14 01:10:12.220204 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 324/649] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:10:12 2022] GET /compute/v2.1/servers/41efe3bb-948d-49f2-974e-c1d3b846b8a8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:10:12.462479 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3dfa401c-cefa-42f1-ba62-988367ab9de9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:12.463076 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3dfa401c-cefa-42f1-ba62-988367ab9de9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:12.475319 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3dfa401c-cefa-42f1-ba62-988367ab9de9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:12.476665 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3dfa401c-cefa-42f1-ba62-988367ab9de9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:12.477318 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3dfa401c-cefa-42f1-ba62-988367ab9de9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:12.478336 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3dfa401c-cefa-42f1-ba62-988367ab9de9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:12.479017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3dfa401c-cefa-42f1-ba62-988367ab9de9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:12.479767 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3dfa401c-cefa-42f1-ba62-988367ab9de9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:12.678392 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3dfa401c-cefa-42f1-ba62-988367ab9de9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:12.687546 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3dfa401c-cefa-42f1-ba62-988367ab9de9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:12.689077 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3dfa401c-cefa-42f1-ba62-988367ab9de9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:12.690237 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3dfa401c-cefa-42f1-ba62-988367ab9de9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1740 microversion: 2.20 time: 0.235729 Sep 14 01:10:12.691338 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 326/650] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:12 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:13.717139 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ec2c4c43-1d51-433a-917e-4b3632dffd45 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:13.718975 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ec2c4c43-1d51-433a-917e-4b3632dffd45 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:13.727321 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec2c4c43-1d51-433a-917e-4b3632dffd45 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:13.727921 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec2c4c43-1d51-433a-917e-4b3632dffd45 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:13.728781 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec2c4c43-1d51-433a-917e-4b3632dffd45 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:13.730132 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec2c4c43-1d51-433a-917e-4b3632dffd45 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:13.730781 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec2c4c43-1d51-433a-917e-4b3632dffd45 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:13.731393 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec2c4c43-1d51-433a-917e-4b3632dffd45 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:13.906275 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ec2c4c43-1d51-433a-917e-4b3632dffd45 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:13.919277 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ec2c4c43-1d51-433a-917e-4b3632dffd45 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:13.920684 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ec2c4c43-1d51-433a-917e-4b3632dffd45 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:13.921849 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ec2c4c43-1d51-433a-917e-4b3632dffd45 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1740 microversion: 2.20 time: 0.208938 Sep 14 01:10:13.923627 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 325/651] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:13 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:14.946876 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2d36f2ee-3f49-46ea-9acc-2105b764b195 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:14.947480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2d36f2ee-3f49-46ea-9acc-2105b764b195 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:14.953888 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d36f2ee-3f49-46ea-9acc-2105b764b195 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:14.954365 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d36f2ee-3f49-46ea-9acc-2105b764b195 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:14.954793 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d36f2ee-3f49-46ea-9acc-2105b764b195 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:14.955472 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d36f2ee-3f49-46ea-9acc-2105b764b195 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:14.955959 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d36f2ee-3f49-46ea-9acc-2105b764b195 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:14.956462 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2d36f2ee-3f49-46ea-9acc-2105b764b195 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:15.084859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2d36f2ee-3f49-46ea-9acc-2105b764b195 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:15.092702 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2d36f2ee-3f49-46ea-9acc-2105b764b195 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:15.094120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2d36f2ee-3f49-46ea-9acc-2105b764b195 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:15.095254 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2d36f2ee-3f49-46ea-9acc-2105b764b195 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1740 microversion: 2.20 time: 0.152308 Sep 14 01:10:15.095836 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 327/652] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:14 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:16.121300 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-bc57d63c-56c2-4ab2-8745-5c63d818f7e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:16.121913 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-bc57d63c-56c2-4ab2-8745-5c63d818f7e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:16.128733 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bc57d63c-56c2-4ab2-8745-5c63d818f7e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:16.129214 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bc57d63c-56c2-4ab2-8745-5c63d818f7e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:16.129652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bc57d63c-56c2-4ab2-8745-5c63d818f7e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:16.130342 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bc57d63c-56c2-4ab2-8745-5c63d818f7e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:16.130801 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bc57d63c-56c2-4ab2-8745-5c63d818f7e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:16.131219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bc57d63c-56c2-4ab2-8745-5c63d818f7e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:16.262144 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bc57d63c-56c2-4ab2-8745-5c63d818f7e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:16.270573 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bc57d63c-56c2-4ab2-8745-5c63d818f7e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:16.272033 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bc57d63c-56c2-4ab2-8745-5c63d818f7e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:16.273178 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-bc57d63c-56c2-4ab2-8745-5c63d818f7e0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1740 microversion: 2.20 time: 0.155829 Sep 14 01:10:16.273730 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 326/653] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:16 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:17.298175 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-12a3f9f5-32e1-4c71-83b2-a3741d5abff9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:17.298694 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-12a3f9f5-32e1-4c71-83b2-a3741d5abff9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:17.305724 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12a3f9f5-32e1-4c71-83b2-a3741d5abff9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:17.306204 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12a3f9f5-32e1-4c71-83b2-a3741d5abff9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:17.306662 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12a3f9f5-32e1-4c71-83b2-a3741d5abff9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:17.307350 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12a3f9f5-32e1-4c71-83b2-a3741d5abff9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:17.307821 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12a3f9f5-32e1-4c71-83b2-a3741d5abff9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:17.308246 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12a3f9f5-32e1-4c71-83b2-a3741d5abff9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:17.435096 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-12a3f9f5-32e1-4c71-83b2-a3741d5abff9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:17.443092 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-12a3f9f5-32e1-4c71-83b2-a3741d5abff9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:17.444536 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-12a3f9f5-32e1-4c71-83b2-a3741d5abff9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:17.445672 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-12a3f9f5-32e1-4c71-83b2-a3741d5abff9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1740 microversion: 2.20 time: 0.151426 Sep 14 01:10:17.446232 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 328/654] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:17 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:18.470886 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-c0bd71d8-7e2b-4531-bd42-cedb496bfcb2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:18.471631 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-c0bd71d8-7e2b-4531-bd42-cedb496bfcb2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:18.477890 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c0bd71d8-7e2b-4531-bd42-cedb496bfcb2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:18.478355 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c0bd71d8-7e2b-4531-bd42-cedb496bfcb2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:18.478795 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c0bd71d8-7e2b-4531-bd42-cedb496bfcb2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:18.479485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c0bd71d8-7e2b-4531-bd42-cedb496bfcb2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:18.479964 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c0bd71d8-7e2b-4531-bd42-cedb496bfcb2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:18.480390 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c0bd71d8-7e2b-4531-bd42-cedb496bfcb2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:18.608729 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c0bd71d8-7e2b-4531-bd42-cedb496bfcb2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:18.617665 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c0bd71d8-7e2b-4531-bd42-cedb496bfcb2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:18.619163 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c0bd71d8-7e2b-4531-bd42-cedb496bfcb2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:18.620699 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-c0bd71d8-7e2b-4531-bd42-cedb496bfcb2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1740 microversion: 2.20 time: 0.153519 Sep 14 01:10:18.621572 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 327/655] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:18 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:18.787816 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-c2245e91-254b-43cc-bc44-10430108c375 req-9089759b-c34b-45a8-a97b-5cc083901b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02da4a4-64f7-47c0-a48f-9cdb71f30df9", "name": "network-vif-unplugged", "status": "completed", "tag": "61ac6a9d-d543-4896-a237-b3287bcd2644"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:10:18.794391 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=64 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:18.798201 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-c2245e91-254b-43cc-bc44-10430108c375 req-9089759b-c34b-45a8-a97b-5cc083901b73 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:18.798748 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-c2245e91-254b-43cc-bc44-10430108c375 req-9089759b-c34b-45a8-a97b-5cc083901b73 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:18.799180 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-c2245e91-254b-43cc-bc44-10430108c375 req-9089759b-c34b-45a8-a97b-5cc083901b73 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:18.813601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-c2245e91-254b-43cc-bc44-10430108c375 req-9089759b-c34b-45a8-a97b-5cc083901b73 service nova] Creating event network-vif-unplugged:61ac6a9d-d543-4896-a237-b3287bcd2644 for instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 on hv-cinder-85752 Sep 14 01:10:18.818642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-c2245e91-254b-43cc-bc44-10430108c375 req-9089759b-c34b-45a8-a97b-5cc083901b73 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035487 Sep 14 01:10:18.819235 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 329/656] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:10:19.646303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8306b0a6-964c-4d71-aa3d-838b97799127 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:19.646918 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8306b0a6-964c-4d71-aa3d-838b97799127 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:19.654372 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8306b0a6-964c-4d71-aa3d-838b97799127 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:19.654862 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8306b0a6-964c-4d71-aa3d-838b97799127 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:19.655302 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8306b0a6-964c-4d71-aa3d-838b97799127 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:19.656034 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8306b0a6-964c-4d71-aa3d-838b97799127 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:19.656497 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8306b0a6-964c-4d71-aa3d-838b97799127 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:19.656932 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8306b0a6-964c-4d71-aa3d-838b97799127 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:19.789666 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8306b0a6-964c-4d71-aa3d-838b97799127 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:19.797881 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8306b0a6-964c-4d71-aa3d-838b97799127 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:19.799292 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8306b0a6-964c-4d71-aa3d-838b97799127 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:19.800467 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8306b0a6-964c-4d71-aa3d-838b97799127 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1722 microversion: 2.20 time: 0.158135 Sep 14 01:10:19.801022 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 328/657] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:19 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:20.828559 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2747c091-4cad-4480-9b10-413de1910e9f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:20.829168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2747c091-4cad-4480-9b10-413de1910e9f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:20.836027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2747c091-4cad-4480-9b10-413de1910e9f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:20.836501 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2747c091-4cad-4480-9b10-413de1910e9f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:20.836935 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2747c091-4cad-4480-9b10-413de1910e9f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:20.837618 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2747c091-4cad-4480-9b10-413de1910e9f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:20.838068 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2747c091-4cad-4480-9b10-413de1910e9f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:20.838489 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2747c091-4cad-4480-9b10-413de1910e9f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:20.971884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2747c091-4cad-4480-9b10-413de1910e9f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:20.980584 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2747c091-4cad-4480-9b10-413de1910e9f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:20.982250 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2747c091-4cad-4480-9b10-413de1910e9f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:20.983529 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2747c091-4cad-4480-9b10-413de1910e9f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1722 microversion: 2.20 time: 0.159881 Sep 14 01:10:20.984196 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 330/658] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:20 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:22.009817 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d71615c6-32da-49fc-8b4f-ae962b11ee29 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:22.010556 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d71615c6-32da-49fc-8b4f-ae962b11ee29 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:22.017477 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d71615c6-32da-49fc-8b4f-ae962b11ee29 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:22.017965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d71615c6-32da-49fc-8b4f-ae962b11ee29 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:22.018407 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d71615c6-32da-49fc-8b4f-ae962b11ee29 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:22.019665 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d71615c6-32da-49fc-8b4f-ae962b11ee29 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:22.020165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d71615c6-32da-49fc-8b4f-ae962b11ee29 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:22.020817 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d71615c6-32da-49fc-8b4f-ae962b11ee29 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:22.153029 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d71615c6-32da-49fc-8b4f-ae962b11ee29 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:22.162094 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d71615c6-32da-49fc-8b4f-ae962b11ee29 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:22.163795 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d71615c6-32da-49fc-8b4f-ae962b11ee29 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:22.164957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d71615c6-32da-49fc-8b4f-ae962b11ee29 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1725 microversion: 2.20 time: 0.160330 Sep 14 01:10:22.165503 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 329/659] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:22 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:22.191957 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-571b9bf9-059f-4033-9623-c108ced04450 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b444da8-5741-41b4-9a05-dc713fe2fce0"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:10:22.194244 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-571b9bf9-059f-4033-9623-c108ced04450 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:22.200781 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-571b9bf9-059f-4033-9623-c108ced04450 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:22.201269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-571b9bf9-059f-4033-9623-c108ced04450 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:22.201708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-571b9bf9-059f-4033-9623-c108ced04450 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:22.202410 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-571b9bf9-059f-4033-9623-c108ced04450 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:22.202864 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-571b9bf9-059f-4033-9623-c108ced04450 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:22.203290 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-571b9bf9-059f-4033-9623-c108ced04450 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:22.481862 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-571b9bf9-059f-4033-9623-c108ced04450 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "POST /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.294458 Sep 14 01:10:22.482536 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 331/660] 10.222.0.42 () {62 vars in 1364 bytes} [Wed Sep 14 01:10:22 2022] POST /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9/os-volume_attachments => generated 188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 01:10:22.608442 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-f22adbc0-c750-4fe0-9eb0-32d32f892236 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:10:22.609043 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-f22adbc0-c750-4fe0-9eb0-32d32f892236 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:22.615223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f22adbc0-c750-4fe0-9eb0-32d32f892236 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:22.615744 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f22adbc0-c750-4fe0-9eb0-32d32f892236 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:22.616179 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f22adbc0-c750-4fe0-9eb0-32d32f892236 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:22.616864 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f22adbc0-c750-4fe0-9eb0-32d32f892236 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:22.617318 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f22adbc0-c750-4fe0-9eb0-32d32f892236 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:22.617742 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f22adbc0-c750-4fe0-9eb0-32d32f892236 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:22.710308 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-f22adbc0-c750-4fe0-9eb0-32d32f892236 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120620) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 01:10:22.778871 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-f22adbc0-c750-4fe0-9eb0-32d32f892236 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "POST /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9/action" status: 202 len: 0 microversion: 2.20 time: 0.174092 Sep 14 01:10:22.779474 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 330/661] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Sep 14 01:10:22 2022] POST /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 01:10:22.788337 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2225977a-45ef-493e-abe0-6e293dab8eb6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:22.788969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2225977a-45ef-493e-abe0-6e293dab8eb6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:22.795480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2225977a-45ef-493e-abe0-6e293dab8eb6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:22.795997 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2225977a-45ef-493e-abe0-6e293dab8eb6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:22.796429 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2225977a-45ef-493e-abe0-6e293dab8eb6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:22.797112 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2225977a-45ef-493e-abe0-6e293dab8eb6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:22.797560 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2225977a-45ef-493e-abe0-6e293dab8eb6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:22.797977 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2225977a-45ef-493e-abe0-6e293dab8eb6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:22.944074 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2225977a-45ef-493e-abe0-6e293dab8eb6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:22.952553 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2225977a-45ef-493e-abe0-6e293dab8eb6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:22.953972 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2225977a-45ef-493e-abe0-6e293dab8eb6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:22.955111 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2225977a-45ef-493e-abe0-6e293dab8eb6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1751 microversion: 2.20 time: 0.171427 Sep 14 01:10:22.955695 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 332/662] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:22 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:10:23.980207 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9303b228-425b-4a39-9458-5eb66f876913 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:23.980813 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9303b228-425b-4a39-9458-5eb66f876913 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:23.987210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9303b228-425b-4a39-9458-5eb66f876913 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:23.988403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9303b228-425b-4a39-9458-5eb66f876913 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:23.988840 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9303b228-425b-4a39-9458-5eb66f876913 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:23.989523 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9303b228-425b-4a39-9458-5eb66f876913 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:23.989981 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9303b228-425b-4a39-9458-5eb66f876913 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:23.990391 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9303b228-425b-4a39-9458-5eb66f876913 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:24.124415 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9303b228-425b-4a39-9458-5eb66f876913 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:24.133364 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9303b228-425b-4a39-9458-5eb66f876913 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:24.134785 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9303b228-425b-4a39-9458-5eb66f876913 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:24.136222 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9303b228-425b-4a39-9458-5eb66f876913 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1751 microversion: 2.20 time: 0.159727 Sep 14 01:10:24.136775 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 331/663] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:23 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:25.160600 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5f26c41b-ab30-405d-b65a-ab8792c32d50 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:25.161199 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5f26c41b-ab30-405d-b65a-ab8792c32d50 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:25.167594 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5f26c41b-ab30-405d-b65a-ab8792c32d50 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:25.168078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5f26c41b-ab30-405d-b65a-ab8792c32d50 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:25.168507 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5f26c41b-ab30-405d-b65a-ab8792c32d50 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:25.169182 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5f26c41b-ab30-405d-b65a-ab8792c32d50 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:25.169632 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5f26c41b-ab30-405d-b65a-ab8792c32d50 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:25.170052 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5f26c41b-ab30-405d-b65a-ab8792c32d50 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:25.302114 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5f26c41b-ab30-405d-b65a-ab8792c32d50 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:25.310543 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5f26c41b-ab30-405d-b65a-ab8792c32d50 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:25.312169 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5f26c41b-ab30-405d-b65a-ab8792c32d50 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:25.313315 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5f26c41b-ab30-405d-b65a-ab8792c32d50 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1751 microversion: 2.20 time: 0.156723 Sep 14 01:10:25.313871 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 333/664] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:25 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:26.351151 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6e1be77d-5f25-4ec9-80f8-9113cdc0c34a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:26.351788 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-6e1be77d-5f25-4ec9-80f8-9113cdc0c34a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:26.358248 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e1be77d-5f25-4ec9-80f8-9113cdc0c34a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:26.358729 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e1be77d-5f25-4ec9-80f8-9113cdc0c34a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:26.359160 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e1be77d-5f25-4ec9-80f8-9113cdc0c34a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:26.359873 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e1be77d-5f25-4ec9-80f8-9113cdc0c34a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:26.360320 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e1be77d-5f25-4ec9-80f8-9113cdc0c34a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:26.360741 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e1be77d-5f25-4ec9-80f8-9113cdc0c34a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:26.492260 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6e1be77d-5f25-4ec9-80f8-9113cdc0c34a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:26.500866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6e1be77d-5f25-4ec9-80f8-9113cdc0c34a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:26.502245 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6e1be77d-5f25-4ec9-80f8-9113cdc0c34a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:26.504017 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-6e1be77d-5f25-4ec9-80f8-9113cdc0c34a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1751 microversion: 2.20 time: 0.156980 Sep 14 01:10:26.504575 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 332/665] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:26 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:27.529223 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-aca3e0a3-f9ae-4e4d-a0c5-dd0e97a6e95c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:27.529849 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-aca3e0a3-f9ae-4e4d-a0c5-dd0e97a6e95c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:27.537560 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aca3e0a3-f9ae-4e4d-a0c5-dd0e97a6e95c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:27.538040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aca3e0a3-f9ae-4e4d-a0c5-dd0e97a6e95c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:27.538474 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aca3e0a3-f9ae-4e4d-a0c5-dd0e97a6e95c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:27.539154 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aca3e0a3-f9ae-4e4d-a0c5-dd0e97a6e95c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:27.539632 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aca3e0a3-f9ae-4e4d-a0c5-dd0e97a6e95c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:27.540055 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aca3e0a3-f9ae-4e4d-a0c5-dd0e97a6e95c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:27.665833 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-aca3e0a3-f9ae-4e4d-a0c5-dd0e97a6e95c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:27.674292 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-aca3e0a3-f9ae-4e4d-a0c5-dd0e97a6e95c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:27.676638 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-aca3e0a3-f9ae-4e4d-a0c5-dd0e97a6e95c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:27.677786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-aca3e0a3-f9ae-4e4d-a0c5-dd0e97a6e95c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1751 microversion: 2.20 time: 0.152453 Sep 14 01:10:27.678348 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 334/666] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:27 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:28.703677 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6e15e545-578b-427d-beb9-c92bc4b21cad tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:28.704321 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-6e15e545-578b-427d-beb9-c92bc4b21cad tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:28.711605 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e15e545-578b-427d-beb9-c92bc4b21cad tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:28.712095 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e15e545-578b-427d-beb9-c92bc4b21cad tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:28.712529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e15e545-578b-427d-beb9-c92bc4b21cad tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:28.713215 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e15e545-578b-427d-beb9-c92bc4b21cad tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:28.713670 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e15e545-578b-427d-beb9-c92bc4b21cad tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:28.714094 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e15e545-578b-427d-beb9-c92bc4b21cad tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:28.734233 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:28.848483 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6e15e545-578b-427d-beb9-c92bc4b21cad tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:28.856803 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6e15e545-578b-427d-beb9-c92bc4b21cad tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:28.858221 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6e15e545-578b-427d-beb9-c92bc4b21cad tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:28.859358 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-6e15e545-578b-427d-beb9-c92bc4b21cad tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1753 microversion: 2.20 time: 0.159626 Sep 14 01:10:28.860084 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 333/667] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:28 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:29.885907 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b660a988-6ca8-4c20-adc8-7f4d7fa70d13 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:29.886446 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b660a988-6ca8-4c20-adc8-7f4d7fa70d13 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:29.893016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b660a988-6ca8-4c20-adc8-7f4d7fa70d13 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:29.893511 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b660a988-6ca8-4c20-adc8-7f4d7fa70d13 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:29.893966 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b660a988-6ca8-4c20-adc8-7f4d7fa70d13 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:29.894666 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b660a988-6ca8-4c20-adc8-7f4d7fa70d13 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:29.895137 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b660a988-6ca8-4c20-adc8-7f4d7fa70d13 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:29.895578 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b660a988-6ca8-4c20-adc8-7f4d7fa70d13 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:30.077242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b660a988-6ca8-4c20-adc8-7f4d7fa70d13 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:30.086508 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b660a988-6ca8-4c20-adc8-7f4d7fa70d13 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:30.087969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b660a988-6ca8-4c20-adc8-7f4d7fa70d13 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:30.089203 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b660a988-6ca8-4c20-adc8-7f4d7fa70d13 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.207663 Sep 14 01:10:30.089763 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 335/668] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:29 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:31.117270 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-46f5c4a7-387b-4336-927b-bef0745a15fd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:31.118622 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-46f5c4a7-387b-4336-927b-bef0745a15fd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:31.127304 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-46f5c4a7-387b-4336-927b-bef0745a15fd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:31.128459 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-46f5c4a7-387b-4336-927b-bef0745a15fd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:31.129654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-46f5c4a7-387b-4336-927b-bef0745a15fd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:31.130558 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-46f5c4a7-387b-4336-927b-bef0745a15fd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:31.131193 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-46f5c4a7-387b-4336-927b-bef0745a15fd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:31.132151 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-46f5c4a7-387b-4336-927b-bef0745a15fd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:31.293606 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-46f5c4a7-387b-4336-927b-bef0745a15fd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:31.302336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-46f5c4a7-387b-4336-927b-bef0745a15fd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:31.303843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-46f5c4a7-387b-4336-927b-bef0745a15fd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:31.305057 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-46f5c4a7-387b-4336-927b-bef0745a15fd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.194906 Sep 14 01:10:31.305619 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 334/669] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:31 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:32.331012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6d9191de-8405-4110-aaba-910e24b573f1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:32.333117 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6d9191de-8405-4110-aaba-910e24b573f1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:32.341675 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d9191de-8405-4110-aaba-910e24b573f1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:32.342692 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d9191de-8405-4110-aaba-910e24b573f1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:32.343228 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d9191de-8405-4110-aaba-910e24b573f1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:32.344248 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d9191de-8405-4110-aaba-910e24b573f1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:32.344960 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d9191de-8405-4110-aaba-910e24b573f1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:32.345533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d9191de-8405-4110-aaba-910e24b573f1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:32.484962 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6d9191de-8405-4110-aaba-910e24b573f1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:32.493688 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6d9191de-8405-4110-aaba-910e24b573f1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:32.495161 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6d9191de-8405-4110-aaba-910e24b573f1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:32.496462 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6d9191de-8405-4110-aaba-910e24b573f1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.169700 Sep 14 01:10:32.497030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 336/670] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:32 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:33.522876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-f4b2db9b-b956-44f1-bd73-cb1c5d601748 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:33.523479 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-f4b2db9b-b956-44f1-bd73-cb1c5d601748 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:33.530073 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f4b2db9b-b956-44f1-bd73-cb1c5d601748 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:33.530554 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f4b2db9b-b956-44f1-bd73-cb1c5d601748 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:33.530986 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f4b2db9b-b956-44f1-bd73-cb1c5d601748 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:33.531737 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f4b2db9b-b956-44f1-bd73-cb1c5d601748 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:33.532191 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f4b2db9b-b956-44f1-bd73-cb1c5d601748 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:33.532699 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f4b2db9b-b956-44f1-bd73-cb1c5d601748 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:33.676333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-f4b2db9b-b956-44f1-bd73-cb1c5d601748 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:33.685628 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-f4b2db9b-b956-44f1-bd73-cb1c5d601748 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:33.687180 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-f4b2db9b-b956-44f1-bd73-cb1c5d601748 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:33.688388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-f4b2db9b-b956-44f1-bd73-cb1c5d601748 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.170265 Sep 14 01:10:33.688947 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 335/671] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:33 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:34.714477 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-df8547e2-6fa6-4c96-834b-359b7911342d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:34.715264 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-df8547e2-6fa6-4c96-834b-359b7911342d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:34.722564 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df8547e2-6fa6-4c96-834b-359b7911342d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:34.723155 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df8547e2-6fa6-4c96-834b-359b7911342d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:34.723711 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df8547e2-6fa6-4c96-834b-359b7911342d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:34.724437 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df8547e2-6fa6-4c96-834b-359b7911342d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:34.724951 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df8547e2-6fa6-4c96-834b-359b7911342d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:34.725351 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-df8547e2-6fa6-4c96-834b-359b7911342d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:34.930730 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-df8547e2-6fa6-4c96-834b-359b7911342d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:34.939465 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-df8547e2-6fa6-4c96-834b-359b7911342d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:34.941560 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-df8547e2-6fa6-4c96-834b-359b7911342d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:34.942827 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-df8547e2-6fa6-4c96-834b-359b7911342d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.232329 Sep 14 01:10:34.943377 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 337/672] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:34 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:35.968378 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e0540b6e-5eab-4465-b8d4-0a89752c1f09 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:35.969065 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-e0540b6e-5eab-4465-b8d4-0a89752c1f09 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:35.972615 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:35.978058 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e0540b6e-5eab-4465-b8d4-0a89752c1f09 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:35.978550 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e0540b6e-5eab-4465-b8d4-0a89752c1f09 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:35.978990 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e0540b6e-5eab-4465-b8d4-0a89752c1f09 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:35.979745 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e0540b6e-5eab-4465-b8d4-0a89752c1f09 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:35.980203 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e0540b6e-5eab-4465-b8d4-0a89752c1f09 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:35.980629 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e0540b6e-5eab-4465-b8d4-0a89752c1f09 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:36.124876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e0540b6e-5eab-4465-b8d4-0a89752c1f09 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:36.141120 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e0540b6e-5eab-4465-b8d4-0a89752c1f09 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:36.142589 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e0540b6e-5eab-4465-b8d4-0a89752c1f09 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:36.144659 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-e0540b6e-5eab-4465-b8d4-0a89752c1f09 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.180291 Sep 14 01:10:36.145322 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 336/673] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:35 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:37.169827 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1aa3a3e2-c833-4e0a-b9a3-58191977b0c8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:37.170509 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1aa3a3e2-c833-4e0a-b9a3-58191977b0c8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:37.177642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1aa3a3e2-c833-4e0a-b9a3-58191977b0c8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:37.178131 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1aa3a3e2-c833-4e0a-b9a3-58191977b0c8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:37.178563 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1aa3a3e2-c833-4e0a-b9a3-58191977b0c8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:37.179266 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1aa3a3e2-c833-4e0a-b9a3-58191977b0c8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:37.179748 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1aa3a3e2-c833-4e0a-b9a3-58191977b0c8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:37.180173 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1aa3a3e2-c833-4e0a-b9a3-58191977b0c8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:37.324305 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1aa3a3e2-c833-4e0a-b9a3-58191977b0c8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:37.327857 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:37.335993 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1aa3a3e2-c833-4e0a-b9a3-58191977b0c8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:37.337379 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1aa3a3e2-c833-4e0a-b9a3-58191977b0c8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:37.338543 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1aa3a3e2-c833-4e0a-b9a3-58191977b0c8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.172885 Sep 14 01:10:37.339101 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 338/674] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:37 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:38.366090 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ac0f8cae-5a50-415a-95bf-a845b8f16d2f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:38.367439 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ac0f8cae-5a50-415a-95bf-a845b8f16d2f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:38.388771 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac0f8cae-5a50-415a-95bf-a845b8f16d2f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:38.389700 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac0f8cae-5a50-415a-95bf-a845b8f16d2f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:38.390126 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac0f8cae-5a50-415a-95bf-a845b8f16d2f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:38.391320 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac0f8cae-5a50-415a-95bf-a845b8f16d2f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:38.391999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac0f8cae-5a50-415a-95bf-a845b8f16d2f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:38.392433 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ac0f8cae-5a50-415a-95bf-a845b8f16d2f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:38.540695 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ac0f8cae-5a50-415a-95bf-a845b8f16d2f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:38.551633 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ac0f8cae-5a50-415a-95bf-a845b8f16d2f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:38.554583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ac0f8cae-5a50-415a-95bf-a845b8f16d2f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:38.556210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ac0f8cae-5a50-415a-95bf-a845b8f16d2f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.195725 Sep 14 01:10:38.566360 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 337/675] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:38 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:39.583246 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8d9b2d63-1130-4878-835f-44dd308c7897 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:39.583990 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8d9b2d63-1130-4878-835f-44dd308c7897 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:39.592163 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d9b2d63-1130-4878-835f-44dd308c7897 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:39.593069 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d9b2d63-1130-4878-835f-44dd308c7897 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:39.593601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d9b2d63-1130-4878-835f-44dd308c7897 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:39.594439 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d9b2d63-1130-4878-835f-44dd308c7897 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:39.594989 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d9b2d63-1130-4878-835f-44dd308c7897 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:39.595527 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d9b2d63-1130-4878-835f-44dd308c7897 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:39.797844 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8d9b2d63-1130-4878-835f-44dd308c7897 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:39.811064 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8d9b2d63-1130-4878-835f-44dd308c7897 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:39.813495 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8d9b2d63-1130-4878-835f-44dd308c7897 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:39.814687 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8d9b2d63-1130-4878-835f-44dd308c7897 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.235831 Sep 14 01:10:39.819628 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 339/676] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:39 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:40.840746 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7c754c46-82c0-4363-800e-e3e53dc3b03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:40.841410 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7c754c46-82c0-4363-800e-e3e53dc3b03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:40.847961 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7c754c46-82c0-4363-800e-e3e53dc3b03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:40.848455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7c754c46-82c0-4363-800e-e3e53dc3b03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:40.848896 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7c754c46-82c0-4363-800e-e3e53dc3b03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:40.849613 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7c754c46-82c0-4363-800e-e3e53dc3b03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:40.850068 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7c754c46-82c0-4363-800e-e3e53dc3b03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:40.850498 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7c754c46-82c0-4363-800e-e3e53dc3b03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:41.016265 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7c754c46-82c0-4363-800e-e3e53dc3b03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:41.035771 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7c754c46-82c0-4363-800e-e3e53dc3b03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:41.037615 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7c754c46-82c0-4363-800e-e3e53dc3b03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:41.039492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7c754c46-82c0-4363-800e-e3e53dc3b03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.202771 Sep 14 01:10:41.040093 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 338/677] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:40 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:42.066033 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a07fe056-ba04-4e43-8ca4-2c85379b6cf9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:42.066700 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a07fe056-ba04-4e43-8ca4-2c85379b6cf9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:42.073088 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a07fe056-ba04-4e43-8ca4-2c85379b6cf9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:42.073563 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a07fe056-ba04-4e43-8ca4-2c85379b6cf9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:42.073998 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a07fe056-ba04-4e43-8ca4-2c85379b6cf9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:42.074672 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a07fe056-ba04-4e43-8ca4-2c85379b6cf9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:42.075151 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a07fe056-ba04-4e43-8ca4-2c85379b6cf9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:42.075615 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a07fe056-ba04-4e43-8ca4-2c85379b6cf9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:42.209877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a07fe056-ba04-4e43-8ca4-2c85379b6cf9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:42.220278 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a07fe056-ba04-4e43-8ca4-2c85379b6cf9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:42.221923 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a07fe056-ba04-4e43-8ca4-2c85379b6cf9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:42.223204 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a07fe056-ba04-4e43-8ca4-2c85379b6cf9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.161827 Sep 14 01:10:42.224093 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 340/678] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:42 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:43.248958 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-671a297d-94da-4ea8-b9ca-204416306f5d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:43.249642 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-671a297d-94da-4ea8-b9ca-204416306f5d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:43.256281 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-671a297d-94da-4ea8-b9ca-204416306f5d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:43.256773 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-671a297d-94da-4ea8-b9ca-204416306f5d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:43.257239 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-671a297d-94da-4ea8-b9ca-204416306f5d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:43.257927 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-671a297d-94da-4ea8-b9ca-204416306f5d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:43.258399 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-671a297d-94da-4ea8-b9ca-204416306f5d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:43.258828 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-671a297d-94da-4ea8-b9ca-204416306f5d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:43.384768 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-671a297d-94da-4ea8-b9ca-204416306f5d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:43.394185 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-671a297d-94da-4ea8-b9ca-204416306f5d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:43.395680 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-671a297d-94da-4ea8-b9ca-204416306f5d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:43.396837 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-671a297d-94da-4ea8-b9ca-204416306f5d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.151805 Sep 14 01:10:43.397394 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 339/679] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:43 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:44.422142 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-bd1ee002-3e82-4dfe-b0ca-cf371df5b25e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:44.422744 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-bd1ee002-3e82-4dfe-b0ca-cf371df5b25e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:44.429747 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bd1ee002-3e82-4dfe-b0ca-cf371df5b25e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:44.430225 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bd1ee002-3e82-4dfe-b0ca-cf371df5b25e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:44.430658 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bd1ee002-3e82-4dfe-b0ca-cf371df5b25e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:44.431341 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bd1ee002-3e82-4dfe-b0ca-cf371df5b25e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:44.431823 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bd1ee002-3e82-4dfe-b0ca-cf371df5b25e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:44.432243 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bd1ee002-3e82-4dfe-b0ca-cf371df5b25e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:44.560825 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-bd1ee002-3e82-4dfe-b0ca-cf371df5b25e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:44.569277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-bd1ee002-3e82-4dfe-b0ca-cf371df5b25e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:44.570737 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-bd1ee002-3e82-4dfe-b0ca-cf371df5b25e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:44.571913 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-bd1ee002-3e82-4dfe-b0ca-cf371df5b25e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.153700 Sep 14 01:10:44.572480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 341/680] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:44 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:45.598555 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d0c628de-040a-4b06-8036-eb27468a9488 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:45.599159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d0c628de-040a-4b06-8036-eb27468a9488 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:45.605602 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d0c628de-040a-4b06-8036-eb27468a9488 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:45.606080 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d0c628de-040a-4b06-8036-eb27468a9488 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:45.606510 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d0c628de-040a-4b06-8036-eb27468a9488 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:45.607188 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d0c628de-040a-4b06-8036-eb27468a9488 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:45.607672 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d0c628de-040a-4b06-8036-eb27468a9488 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:45.608089 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d0c628de-040a-4b06-8036-eb27468a9488 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:45.740902 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d0c628de-040a-4b06-8036-eb27468a9488 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:45.749565 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d0c628de-040a-4b06-8036-eb27468a9488 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:45.751016 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d0c628de-040a-4b06-8036-eb27468a9488 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:45.752205 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d0c628de-040a-4b06-8036-eb27468a9488 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.158691 Sep 14 01:10:45.752886 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 340/681] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:45 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:46.777228 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3120f0f3-d91e-4449-b457-c38d3a978443 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:46.777835 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3120f0f3-d91e-4449-b457-c38d3a978443 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:46.785070 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3120f0f3-d91e-4449-b457-c38d3a978443 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:46.785572 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3120f0f3-d91e-4449-b457-c38d3a978443 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:46.785993 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3120f0f3-d91e-4449-b457-c38d3a978443 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:46.786683 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3120f0f3-d91e-4449-b457-c38d3a978443 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:46.787142 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3120f0f3-d91e-4449-b457-c38d3a978443 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:46.787583 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3120f0f3-d91e-4449-b457-c38d3a978443 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:46.918192 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3120f0f3-d91e-4449-b457-c38d3a978443 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:46.927387 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3120f0f3-d91e-4449-b457-c38d3a978443 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:46.928851 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3120f0f3-d91e-4449-b457-c38d3a978443 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:46.929992 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3120f0f3-d91e-4449-b457-c38d3a978443 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.156650 Sep 14 01:10:46.930546 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 342/682] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:46 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:47.955960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-3e504f18-d3b2-4702-bc36-7abdc7cfe698 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:47.956569 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-3e504f18-d3b2-4702-bc36-7abdc7cfe698 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:47.962518 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3e504f18-d3b2-4702-bc36-7abdc7cfe698 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:47.963001 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3e504f18-d3b2-4702-bc36-7abdc7cfe698 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:47.963439 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3e504f18-d3b2-4702-bc36-7abdc7cfe698 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:47.964162 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3e504f18-d3b2-4702-bc36-7abdc7cfe698 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:47.964618 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3e504f18-d3b2-4702-bc36-7abdc7cfe698 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:47.965039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3e504f18-d3b2-4702-bc36-7abdc7cfe698 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:48.093466 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-3e504f18-d3b2-4702-bc36-7abdc7cfe698 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:48.102517 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-3e504f18-d3b2-4702-bc36-7abdc7cfe698 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:48.103984 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-3e504f18-d3b2-4702-bc36-7abdc7cfe698 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:48.105125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-3e504f18-d3b2-4702-bc36-7abdc7cfe698 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.153276 Sep 14 01:10:48.105683 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 341/683] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:47 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:49.131314 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-cccff82a-b422-4205-99db-88f7196a76cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:49.131979 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-cccff82a-b422-4205-99db-88f7196a76cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:49.134291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=28 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:49.139943 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cccff82a-b422-4205-99db-88f7196a76cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:49.140431 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cccff82a-b422-4205-99db-88f7196a76cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:49.140882 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cccff82a-b422-4205-99db-88f7196a76cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:49.141575 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cccff82a-b422-4205-99db-88f7196a76cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:49.142033 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cccff82a-b422-4205-99db-88f7196a76cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:49.142462 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cccff82a-b422-4205-99db-88f7196a76cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:49.268608 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cccff82a-b422-4205-99db-88f7196a76cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:49.277410 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cccff82a-b422-4205-99db-88f7196a76cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:49.278860 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cccff82a-b422-4205-99db-88f7196a76cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:49.280052 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-cccff82a-b422-4205-99db-88f7196a76cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.153299 Sep 14 01:10:49.280610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 343/684] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:49 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:50.308578 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ecb57ac9-7885-4c95-8fd0-34fe3201aad2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:50.309258 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ecb57ac9-7885-4c95-8fd0-34fe3201aad2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:50.316730 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ecb57ac9-7885-4c95-8fd0-34fe3201aad2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:50.317227 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ecb57ac9-7885-4c95-8fd0-34fe3201aad2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:50.317736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ecb57ac9-7885-4c95-8fd0-34fe3201aad2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:50.318477 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ecb57ac9-7885-4c95-8fd0-34fe3201aad2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:50.318943 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ecb57ac9-7885-4c95-8fd0-34fe3201aad2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:50.319360 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ecb57ac9-7885-4c95-8fd0-34fe3201aad2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:50.450320 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ecb57ac9-7885-4c95-8fd0-34fe3201aad2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:50.459546 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ecb57ac9-7885-4c95-8fd0-34fe3201aad2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:50.460995 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ecb57ac9-7885-4c95-8fd0-34fe3201aad2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:50.462139 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ecb57ac9-7885-4c95-8fd0-34fe3201aad2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.158078 Sep 14 01:10:50.462681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 342/685] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:50 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:51.261490 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2af666c6-6c9e-43da-9a8e-958355124e46 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de8dc9db-36c3-4686-b36f-5f3775282013"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:10:51.263966 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2af666c6-6c9e-43da-9a8e-958355124e46 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:51.270536 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2af666c6-6c9e-43da-9a8e-958355124e46 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:51.271047 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2af666c6-6c9e-43da-9a8e-958355124e46 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:51.271477 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2af666c6-6c9e-43da-9a8e-958355124e46 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:51.272206 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2af666c6-6c9e-43da-9a8e-958355124e46 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:51.272660 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2af666c6-6c9e-43da-9a8e-958355124e46 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:51.273096 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2af666c6-6c9e-43da-9a8e-958355124e46 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:51.488076 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e5be1281-9a4f-469e-a2a7-e785f0b41998 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:51.488684 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-e5be1281-9a4f-469e-a2a7-e785f0b41998 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:51.495249 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e5be1281-9a4f-469e-a2a7-e785f0b41998 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:51.495861 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e5be1281-9a4f-469e-a2a7-e785f0b41998 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:51.496304 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e5be1281-9a4f-469e-a2a7-e785f0b41998 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:51.496998 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e5be1281-9a4f-469e-a2a7-e785f0b41998 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:51.497452 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e5be1281-9a4f-469e-a2a7-e785f0b41998 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:51.497875 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e5be1281-9a4f-469e-a2a7-e785f0b41998 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:51.550780 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2af666c6-6c9e-43da-9a8e-958355124e46 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "POST /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.461233 Sep 14 01:10:51.551659 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 344/686] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 01:10:51 2022] POST /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa/os-volume_attachments => generated 194 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:10:51.641195 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e5be1281-9a4f-469e-a2a7-e785f0b41998 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:51.650545 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e5be1281-9a4f-469e-a2a7-e785f0b41998 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:51.652276 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e5be1281-9a4f-469e-a2a7-e785f0b41998 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:51.653433 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-e5be1281-9a4f-469e-a2a7-e785f0b41998 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.169364 Sep 14 01:10:51.654021 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 343/687] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:51 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:10:52.680118 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-11b671fa-2bfa-4c4d-bd43-0989eec9cb55 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:52.680775 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-11b671fa-2bfa-4c4d-bd43-0989eec9cb55 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:52.687642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11b671fa-2bfa-4c4d-bd43-0989eec9cb55 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:52.688132 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11b671fa-2bfa-4c4d-bd43-0989eec9cb55 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:52.688607 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11b671fa-2bfa-4c4d-bd43-0989eec9cb55 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:52.689919 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11b671fa-2bfa-4c4d-bd43-0989eec9cb55 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:52.690476 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11b671fa-2bfa-4c4d-bd43-0989eec9cb55 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:52.691014 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-11b671fa-2bfa-4c4d-bd43-0989eec9cb55 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:53.188315 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-11b671fa-2bfa-4c4d-bd43-0989eec9cb55 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:53.197847 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-11b671fa-2bfa-4c4d-bd43-0989eec9cb55 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:53.199304 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-11b671fa-2bfa-4c4d-bd43-0989eec9cb55 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:53.200509 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-11b671fa-2bfa-4c4d-bd43-0989eec9cb55 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.524776 Sep 14 01:10:53.201261 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 345/688] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:52 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:54.226174 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-cd9e5226-295b-40bc-96a2-f1c62e736eb1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:54.226799 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-cd9e5226-295b-40bc-96a2-f1c62e736eb1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:54.233139 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cd9e5226-295b-40bc-96a2-f1c62e736eb1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:54.233619 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cd9e5226-295b-40bc-96a2-f1c62e736eb1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:54.234052 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cd9e5226-295b-40bc-96a2-f1c62e736eb1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:54.234729 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cd9e5226-295b-40bc-96a2-f1c62e736eb1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:54.235232 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cd9e5226-295b-40bc-96a2-f1c62e736eb1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:54.235621 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cd9e5226-295b-40bc-96a2-f1c62e736eb1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:54.373270 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-cd9e5226-295b-40bc-96a2-f1c62e736eb1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:54.382361 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-cd9e5226-295b-40bc-96a2-f1c62e736eb1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:54.383835 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-cd9e5226-295b-40bc-96a2-f1c62e736eb1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:54.385026 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-cd9e5226-295b-40bc-96a2-f1c62e736eb1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.162782 Sep 14 01:10:54.385836 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 344/689] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:54 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:55.411268 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3ea6aab6-f2a0-406f-82d7-2ea5c2305ee4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:55.411920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3ea6aab6-f2a0-406f-82d7-2ea5c2305ee4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:55.418299 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ea6aab6-f2a0-406f-82d7-2ea5c2305ee4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:55.418784 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ea6aab6-f2a0-406f-82d7-2ea5c2305ee4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:55.419218 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ea6aab6-f2a0-406f-82d7-2ea5c2305ee4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:55.419929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ea6aab6-f2a0-406f-82d7-2ea5c2305ee4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:55.420383 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ea6aab6-f2a0-406f-82d7-2ea5c2305ee4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:55.420812 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3ea6aab6-f2a0-406f-82d7-2ea5c2305ee4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:55.550741 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3ea6aab6-f2a0-406f-82d7-2ea5c2305ee4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:55.559255 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3ea6aab6-f2a0-406f-82d7-2ea5c2305ee4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:55.560706 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3ea6aab6-f2a0-406f-82d7-2ea5c2305ee4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:55.561851 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3ea6aab6-f2a0-406f-82d7-2ea5c2305ee4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.155451 Sep 14 01:10:55.562398 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 346/690] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:55 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:56.588403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-32874676-a698-41e8-b5c0-18e412d65b78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:56.589039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-32874676-a698-41e8-b5c0-18e412d65b78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:56.595986 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-32874676-a698-41e8-b5c0-18e412d65b78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:56.596475 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-32874676-a698-41e8-b5c0-18e412d65b78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:56.596911 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-32874676-a698-41e8-b5c0-18e412d65b78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:56.597595 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-32874676-a698-41e8-b5c0-18e412d65b78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:56.598049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-32874676-a698-41e8-b5c0-18e412d65b78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:56.598466 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-32874676-a698-41e8-b5c0-18e412d65b78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:56.728043 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-32874676-a698-41e8-b5c0-18e412d65b78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:56.736826 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-32874676-a698-41e8-b5c0-18e412d65b78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:56.738193 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-32874676-a698-41e8-b5c0-18e412d65b78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:56.739340 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-32874676-a698-41e8-b5c0-18e412d65b78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.154851 Sep 14 01:10:56.739924 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 345/691] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:56 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:57.764043 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-49f09a9d-772c-47a8-bc5b-e0e04190c321 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:57.764585 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-49f09a9d-772c-47a8-bc5b-e0e04190c321 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:57.772109 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49f09a9d-772c-47a8-bc5b-e0e04190c321 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:57.772589 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49f09a9d-772c-47a8-bc5b-e0e04190c321 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:57.773020 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49f09a9d-772c-47a8-bc5b-e0e04190c321 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:57.773708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49f09a9d-772c-47a8-bc5b-e0e04190c321 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:57.774167 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49f09a9d-772c-47a8-bc5b-e0e04190c321 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:57.774581 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-49f09a9d-772c-47a8-bc5b-e0e04190c321 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:57.905471 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-49f09a9d-772c-47a8-bc5b-e0e04190c321 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:57.915075 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-49f09a9d-772c-47a8-bc5b-e0e04190c321 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:57.916977 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-49f09a9d-772c-47a8-bc5b-e0e04190c321 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:57.917702 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-49f09a9d-772c-47a8-bc5b-e0e04190c321 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.157906 Sep 14 01:10:57.918261 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 347/692] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:57 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:10:58.943548 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-5b603da9-84a4-40ff-870c-2b5f80bdf71f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:10:58.944348 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-5b603da9-84a4-40ff-870c-2b5f80bdf71f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:10:58.950535 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5b603da9-84a4-40ff-870c-2b5f80bdf71f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:58.951015 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5b603da9-84a4-40ff-870c-2b5f80bdf71f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:58.951444 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5b603da9-84a4-40ff-870c-2b5f80bdf71f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:58.952149 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5b603da9-84a4-40ff-870c-2b5f80bdf71f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:10:58.952596 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5b603da9-84a4-40ff-870c-2b5f80bdf71f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:10:58.953011 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5b603da9-84a4-40ff-870c-2b5f80bdf71f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:10:58.957652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=75 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:10:59.099989 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-5b603da9-84a4-40ff-870c-2b5f80bdf71f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:59.108669 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-5b603da9-84a4-40ff-870c-2b5f80bdf71f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:59.110228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-5b603da9-84a4-40ff-870c-2b5f80bdf71f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:10:59.112023 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-5b603da9-84a4-40ff-870c-2b5f80bdf71f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.172734 Sep 14 01:10:59.112581 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 346/693] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:10:58 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:11:00.137449 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-cfe6be93-5783-48cc-944d-2d4bc98105cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:00.138067 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-cfe6be93-5783-48cc-944d-2d4bc98105cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:00.151848 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cfe6be93-5783-48cc-944d-2d4bc98105cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:00.151848 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cfe6be93-5783-48cc-944d-2d4bc98105cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:00.151848 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cfe6be93-5783-48cc-944d-2d4bc98105cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:00.151848 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cfe6be93-5783-48cc-944d-2d4bc98105cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:00.152188 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cfe6be93-5783-48cc-944d-2d4bc98105cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:00.152188 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cfe6be93-5783-48cc-944d-2d4bc98105cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:00.161820 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-56de3373-cecd-40e1-9d69-44e2315d44b5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:11:00.165399 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-56de3373-cecd-40e1-9d69-44e2315d44b5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:00.174076 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-56de3373-cecd-40e1-9d69-44e2315d44b5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:00.174807 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-56de3373-cecd-40e1-9d69-44e2315d44b5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:00.175393 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-56de3373-cecd-40e1-9d69-44e2315d44b5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:00.176134 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-56de3373-cecd-40e1-9d69-44e2315d44b5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:00.176715 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-56de3373-cecd-40e1-9d69-44e2315d44b5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:00.177151 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-56de3373-cecd-40e1-9d69-44e2315d44b5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:00.205224 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-56de3373-cecd-40e1-9d69-44e2315d44b5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lazy-loading 'flavor' on Instance uuid 413d7106-fff0-4516-b70d-1d687312c9aa {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:11:00.293222 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cfe6be93-5783-48cc-944d-2d4bc98105cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:00.302745 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cfe6be93-5783-48cc-944d-2d4bc98105cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:00.305618 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cfe6be93-5783-48cc-944d-2d4bc98105cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:00.306799 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-cfe6be93-5783-48cc-944d-2d4bc98105cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.174012 Sep 14 01:11:00.315975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 348/694] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:11:00 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:11:00.351414 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-56de3373-cecd-40e1-9d69-44e2315d44b5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "POST /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa/action" status: 200 len: 32 microversion: 2.1 time: 0.194350 Sep 14 01:11:00.357218 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 347/695] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 01:11:00 2022] POST /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa/action => generated 32 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 01:11:00.364681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-804cda97-9e4f-4273-8949-fb9fa936acd8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:00.365605 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-804cda97-9e4f-4273-8949-fb9fa936acd8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:00.374383 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-804cda97-9e4f-4273-8949-fb9fa936acd8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:00.374998 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-804cda97-9e4f-4273-8949-fb9fa936acd8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:00.375310 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-804cda97-9e4f-4273-8949-fb9fa936acd8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:00.376069 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-804cda97-9e4f-4273-8949-fb9fa936acd8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:00.377071 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-804cda97-9e4f-4273-8949-fb9fa936acd8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:00.378243 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-804cda97-9e4f-4273-8949-fb9fa936acd8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:00.521376 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-804cda97-9e4f-4273-8949-fb9fa936acd8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:00.530019 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-804cda97-9e4f-4273-8949-fb9fa936acd8 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1735 microversion: 2.1 time: 0.171463 Sep 14 01:11:00.530853 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 348/696] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:00 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:00.539578 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-ab239149-36a3-4e0a-ad4c-050a678123fb req-2f890ef3-2ea4-4281-b280-261302c06186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02da4a4-64f7-47c0-a48f-9cdb71f30df9", "name": "network-vif-plugged", "status": "completed", "tag": "61ac6a9d-d543-4896-a237-b3287bcd2644"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:11:00.549967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-ab239149-36a3-4e0a-ad4c-050a678123fb req-2f890ef3-2ea4-4281-b280-261302c06186 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:00.550373 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-ab239149-36a3-4e0a-ad4c-050a678123fb req-2f890ef3-2ea4-4281-b280-261302c06186 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:00.550800 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-ab239149-36a3-4e0a-ad4c-050a678123fb req-2f890ef3-2ea4-4281-b280-261302c06186 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:00.561923 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-ab239149-36a3-4e0a-ad4c-050a678123fb req-2f890ef3-2ea4-4281-b280-261302c06186 service nova] Creating event network-vif-plugged:61ac6a9d-d543-4896-a237-b3287bcd2644 for instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 on hv-cinder-85752 Sep 14 01:11:00.567299 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-ab239149-36a3-4e0a-ad4c-050a678123fb req-2f890ef3-2ea4-4281-b280-261302c06186 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250115 Sep 14 01:11:00.568167 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 349/697] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:11:01.333465 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-707bb157-a5ea-4b71-906a-e39296fa877b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:01.334038 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-707bb157-a5ea-4b71-906a-e39296fa877b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:01.340406 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-707bb157-a5ea-4b71-906a-e39296fa877b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:01.340835 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-707bb157-a5ea-4b71-906a-e39296fa877b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:01.341277 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-707bb157-a5ea-4b71-906a-e39296fa877b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:01.341970 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-707bb157-a5ea-4b71-906a-e39296fa877b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:01.342424 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-707bb157-a5ea-4b71-906a-e39296fa877b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:01.342850 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-707bb157-a5ea-4b71-906a-e39296fa877b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:01.474960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-707bb157-a5ea-4b71-906a-e39296fa877b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:01.483641 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-707bb157-a5ea-4b71-906a-e39296fa877b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:01.485077 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-707bb157-a5ea-4b71-906a-e39296fa877b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:01.486877 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-707bb157-a5ea-4b71-906a-e39296fa877b tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.158439 Sep 14 01:11:01.487425 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 349/698] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:11:01 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:11:01.555072 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3db81cdb-c4cd-4167-9e04-298717ba9004 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:01.555825 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3db81cdb-c4cd-4167-9e04-298717ba9004 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:01.561917 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3db81cdb-c4cd-4167-9e04-298717ba9004 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:01.562402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3db81cdb-c4cd-4167-9e04-298717ba9004 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:01.562841 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3db81cdb-c4cd-4167-9e04-298717ba9004 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:01.563532 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3db81cdb-c4cd-4167-9e04-298717ba9004 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:01.564058 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3db81cdb-c4cd-4167-9e04-298717ba9004 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:01.564490 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3db81cdb-c4cd-4167-9e04-298717ba9004 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:01.691954 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3db81cdb-c4cd-4167-9e04-298717ba9004 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:01.700236 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3db81cdb-c4cd-4167-9e04-298717ba9004 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1735 microversion: 2.1 time: 0.149980 Sep 14 01:11:01.700802 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 350/699] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:01 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:11:02.512401 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6e8d7d55-2c02-4800-b93c-c9d2e0382c42 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:02.513012 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-6e8d7d55-2c02-4800-b93c-c9d2e0382c42 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:02.519441 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e8d7d55-2c02-4800-b93c-c9d2e0382c42 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:02.519980 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e8d7d55-2c02-4800-b93c-c9d2e0382c42 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:02.520423 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e8d7d55-2c02-4800-b93c-c9d2e0382c42 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:02.521115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e8d7d55-2c02-4800-b93c-c9d2e0382c42 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:02.521577 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e8d7d55-2c02-4800-b93c-c9d2e0382c42 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:02.522002 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6e8d7d55-2c02-4800-b93c-c9d2e0382c42 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:02.650926 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6e8d7d55-2c02-4800-b93c-c9d2e0382c42 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:02.660532 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6e8d7d55-2c02-4800-b93c-c9d2e0382c42 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:02.662196 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6e8d7d55-2c02-4800-b93c-c9d2e0382c42 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:02.663983 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-6e8d7d55-2c02-4800-b93c-c9d2e0382c42 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.155229 Sep 14 01:11:02.664750 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 350/700] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:11:02 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:11:02.724071 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3b8a62dc-4cc9-4db5-99fd-190052f0519b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:02.724705 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3b8a62dc-4cc9-4db5-99fd-190052f0519b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:02.731156 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3b8a62dc-4cc9-4db5-99fd-190052f0519b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:02.731608 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3b8a62dc-4cc9-4db5-99fd-190052f0519b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:02.732041 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3b8a62dc-4cc9-4db5-99fd-190052f0519b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:02.732722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3b8a62dc-4cc9-4db5-99fd-190052f0519b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:02.733169 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3b8a62dc-4cc9-4db5-99fd-190052f0519b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:02.733591 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3b8a62dc-4cc9-4db5-99fd-190052f0519b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:02.865314 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3b8a62dc-4cc9-4db5-99fd-190052f0519b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:02.873426 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3b8a62dc-4cc9-4db5-99fd-190052f0519b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1735 microversion: 2.1 time: 0.153659 Sep 14 01:11:02.873992 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 351/701] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:02 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:03.689687 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-b2eabb28-160b-4a12-a926-99c384d12f78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:03.690500 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-b2eabb28-160b-4a12-a926-99c384d12f78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:03.697600 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b2eabb28-160b-4a12-a926-99c384d12f78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:03.698079 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b2eabb28-160b-4a12-a926-99c384d12f78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:03.698515 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b2eabb28-160b-4a12-a926-99c384d12f78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:03.699199 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b2eabb28-160b-4a12-a926-99c384d12f78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:03.699839 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b2eabb28-160b-4a12-a926-99c384d12f78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:03.700260 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b2eabb28-160b-4a12-a926-99c384d12f78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:03.833867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b2eabb28-160b-4a12-a926-99c384d12f78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:03.843673 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b2eabb28-160b-4a12-a926-99c384d12f78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:03.847754 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b2eabb28-160b-4a12-a926-99c384d12f78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:03.848125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-b2eabb28-160b-4a12-a926-99c384d12f78 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1809 microversion: 2.20 time: 0.162490 Sep 14 01:11:03.848553 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 351/702] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:11:03 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:11:03.897378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ddb73024-f307-4f04-a599-ffd2270bf7e6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:03.898058 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ddb73024-f307-4f04-a599-ffd2270bf7e6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:03.905291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ddb73024-f307-4f04-a599-ffd2270bf7e6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:03.905943 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ddb73024-f307-4f04-a599-ffd2270bf7e6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:03.906443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ddb73024-f307-4f04-a599-ffd2270bf7e6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:03.907269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ddb73024-f307-4f04-a599-ffd2270bf7e6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:03.908527 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ddb73024-f307-4f04-a599-ffd2270bf7e6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:03.908948 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ddb73024-f307-4f04-a599-ffd2270bf7e6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:04.046781 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ddb73024-f307-4f04-a599-ffd2270bf7e6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:04.055325 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ddb73024-f307-4f04-a599-ffd2270bf7e6 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1735 microversion: 2.1 time: 0.162148 Sep 14 01:11:04.055959 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 352/703] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:03 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:04.873464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0ba8af31-6e1a-4b57-9437-02ccd952b0ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:04.873983 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0ba8af31-6e1a-4b57-9437-02ccd952b0ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:04.881313 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0ba8af31-6e1a-4b57-9437-02ccd952b0ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:04.881786 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0ba8af31-6e1a-4b57-9437-02ccd952b0ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:04.882218 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0ba8af31-6e1a-4b57-9437-02ccd952b0ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:04.882897 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0ba8af31-6e1a-4b57-9437-02ccd952b0ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:04.883344 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0ba8af31-6e1a-4b57-9437-02ccd952b0ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:04.883784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0ba8af31-6e1a-4b57-9437-02ccd952b0ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:05.011427 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0ba8af31-6e1a-4b57-9437-02ccd952b0ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:05.020563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0ba8af31-6e1a-4b57-9437-02ccd952b0ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:05.022011 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0ba8af31-6e1a-4b57-9437-02ccd952b0ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:05.023163 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0ba8af31-6e1a-4b57-9437-02ccd952b0ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1796 microversion: 2.20 time: 0.153754 Sep 14 01:11:05.023780 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 352/704] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:11:04 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1796 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:11:05.078041 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0fb0d4a2-93b4-448e-9c37-52efa160f729 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:05.078645 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0fb0d4a2-93b4-448e-9c37-52efa160f729 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:05.086095 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0fb0d4a2-93b4-448e-9c37-52efa160f729 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:05.086582 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0fb0d4a2-93b4-448e-9c37-52efa160f729 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:05.087021 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0fb0d4a2-93b4-448e-9c37-52efa160f729 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:05.087807 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0fb0d4a2-93b4-448e-9c37-52efa160f729 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:05.088265 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0fb0d4a2-93b4-448e-9c37-52efa160f729 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:05.088692 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0fb0d4a2-93b4-448e-9c37-52efa160f729 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:05.214827 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0fb0d4a2-93b4-448e-9c37-52efa160f729 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:05.223522 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0fb0d4a2-93b4-448e-9c37-52efa160f729 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1735 microversion: 2.1 time: 0.149315 Sep 14 01:11:05.224117 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 353/705] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:05 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:06.246288 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-df856c4c-7af1-4ccd-9ec8-da2fc06d655c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:06.246905 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-df856c4c-7af1-4ccd-9ec8-da2fc06d655c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:06.249326 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=34 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:06.255334 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-df856c4c-7af1-4ccd-9ec8-da2fc06d655c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:06.255852 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-df856c4c-7af1-4ccd-9ec8-da2fc06d655c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:06.256297 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-df856c4c-7af1-4ccd-9ec8-da2fc06d655c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:06.256990 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-df856c4c-7af1-4ccd-9ec8-da2fc06d655c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:06.257452 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-df856c4c-7af1-4ccd-9ec8-da2fc06d655c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:06.257878 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-df856c4c-7af1-4ccd-9ec8-da2fc06d655c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:06.384726 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-df856c4c-7af1-4ccd-9ec8-da2fc06d655c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:06.393340 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-df856c4c-7af1-4ccd-9ec8-da2fc06d655c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1735 microversion: 2.1 time: 0.150992 Sep 14 01:11:06.393906 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 353/706] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:06 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:07.416116 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b1c65640-198a-463b-a1cd-e3b4210ed2f9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:07.416729 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b1c65640-198a-463b-a1cd-e3b4210ed2f9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:07.423304 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b1c65640-198a-463b-a1cd-e3b4210ed2f9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:07.423973 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b1c65640-198a-463b-a1cd-e3b4210ed2f9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:07.424429 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b1c65640-198a-463b-a1cd-e3b4210ed2f9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:07.425189 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b1c65640-198a-463b-a1cd-e3b4210ed2f9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:07.425643 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b1c65640-198a-463b-a1cd-e3b4210ed2f9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:07.426070 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b1c65640-198a-463b-a1cd-e3b4210ed2f9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:07.558962 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b1c65640-198a-463b-a1cd-e3b4210ed2f9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:07.562501 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:07.567987 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b1c65640-198a-463b-a1cd-e3b4210ed2f9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1735 microversion: 2.1 time: 0.155679 Sep 14 01:11:07.568591 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 354/707] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:07 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:08.591784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-76b076d5-01ca-4771-b369-ba8380c71d8e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:08.592396 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-76b076d5-01ca-4771-b369-ba8380c71d8e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:08.599148 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-76b076d5-01ca-4771-b369-ba8380c71d8e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:08.599659 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-76b076d5-01ca-4771-b369-ba8380c71d8e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:08.600117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-76b076d5-01ca-4771-b369-ba8380c71d8e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:08.600834 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-76b076d5-01ca-4771-b369-ba8380c71d8e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:08.601288 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-76b076d5-01ca-4771-b369-ba8380c71d8e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:08.601707 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-76b076d5-01ca-4771-b369-ba8380c71d8e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:08.730998 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-76b076d5-01ca-4771-b369-ba8380c71d8e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:08.740028 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-76b076d5-01ca-4771-b369-ba8380c71d8e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1735 microversion: 2.1 time: 0.152158 Sep 14 01:11:08.740585 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 354/708] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:08 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:09.764295 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-86952e6b-e53f-40e5-b29b-8787743ebd84 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:09.764905 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-86952e6b-e53f-40e5-b29b-8787743ebd84 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:09.772942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-86952e6b-e53f-40e5-b29b-8787743ebd84 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:09.773424 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-86952e6b-e53f-40e5-b29b-8787743ebd84 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:09.773860 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-86952e6b-e53f-40e5-b29b-8787743ebd84 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:09.774547 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-86952e6b-e53f-40e5-b29b-8787743ebd84 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:09.775002 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-86952e6b-e53f-40e5-b29b-8787743ebd84 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:09.775425 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-86952e6b-e53f-40e5-b29b-8787743ebd84 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:09.901883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-86952e6b-e53f-40e5-b29b-8787743ebd84 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:09.909995 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-86952e6b-e53f-40e5-b29b-8787743ebd84 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1735 microversion: 2.1 time: 0.149851 Sep 14 01:11:09.910565 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 355/709] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:09 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:10.933952 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-3d56b81e-b006-4c38-b043-79bebfdce95c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:10.934560 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-3d56b81e-b006-4c38-b043-79bebfdce95c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:10.942017 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3d56b81e-b006-4c38-b043-79bebfdce95c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:10.942495 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3d56b81e-b006-4c38-b043-79bebfdce95c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:10.942933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3d56b81e-b006-4c38-b043-79bebfdce95c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:10.943699 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3d56b81e-b006-4c38-b043-79bebfdce95c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:10.944180 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3d56b81e-b006-4c38-b043-79bebfdce95c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:10.944600 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3d56b81e-b006-4c38-b043-79bebfdce95c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:11.073715 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-3d56b81e-b006-4c38-b043-79bebfdce95c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:11.082166 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-3d56b81e-b006-4c38-b043-79bebfdce95c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1735 microversion: 2.1 time: 0.152076 Sep 14 01:11:11.082737 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 355/710] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:10 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:12.106020 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4b53a283-9300-4f4c-9fb9-51b9588f1293 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:12.106627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4b53a283-9300-4f4c-9fb9-51b9588f1293 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:12.113614 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b53a283-9300-4f4c-9fb9-51b9588f1293 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:12.114096 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b53a283-9300-4f4c-9fb9-51b9588f1293 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:12.114532 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b53a283-9300-4f4c-9fb9-51b9588f1293 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:12.115227 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b53a283-9300-4f4c-9fb9-51b9588f1293 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:12.115717 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b53a283-9300-4f4c-9fb9-51b9588f1293 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:12.116143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b53a283-9300-4f4c-9fb9-51b9588f1293 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:12.246748 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4b53a283-9300-4f4c-9fb9-51b9588f1293 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:12.255509 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4b53a283-9300-4f4c-9fb9-51b9588f1293 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1735 microversion: 2.1 time: 0.153399 Sep 14 01:11:12.256099 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 356/711] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:12 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:13.278422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-cb991705-50b7-47b4-9d41-45986f956db2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:13.279080 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-cb991705-50b7-47b4-9d41-45986f956db2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:13.285559 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cb991705-50b7-47b4-9d41-45986f956db2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:13.286042 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cb991705-50b7-47b4-9d41-45986f956db2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:13.286475 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cb991705-50b7-47b4-9d41-45986f956db2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:13.287166 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cb991705-50b7-47b4-9d41-45986f956db2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:13.287641 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cb991705-50b7-47b4-9d41-45986f956db2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:13.288053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cb991705-50b7-47b4-9d41-45986f956db2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:13.422516 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-cb991705-50b7-47b4-9d41-45986f956db2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:13.431250 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-cb991705-50b7-47b4-9d41-45986f956db2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1735 microversion: 2.1 time: 0.156655 Sep 14 01:11:13.431897 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 356/712] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:13 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:11:14.456333 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-090df81b-2c8f-41c6-8aab-c95f0fef9b11 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:14.457012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-090df81b-2c8f-41c6-8aab-c95f0fef9b11 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:14.463934 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-090df81b-2c8f-41c6-8aab-c95f0fef9b11 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:14.464465 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-090df81b-2c8f-41c6-8aab-c95f0fef9b11 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:14.464919 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-090df81b-2c8f-41c6-8aab-c95f0fef9b11 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:14.465653 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-090df81b-2c8f-41c6-8aab-c95f0fef9b11 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:14.466152 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-090df81b-2c8f-41c6-8aab-c95f0fef9b11 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:14.466599 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-090df81b-2c8f-41c6-8aab-c95f0fef9b11 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:14.595591 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-090df81b-2c8f-41c6-8aab-c95f0fef9b11 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:14.603820 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-090df81b-2c8f-41c6-8aab-c95f0fef9b11 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1735 microversion: 2.1 time: 0.151878 Sep 14 01:11:14.604392 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 357/713] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:14 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:15.627630 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0fcc9d0c-68f0-49e2-9b7d-9e29b995c3bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:15.628248 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0fcc9d0c-68f0-49e2-9b7d-9e29b995c3bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:15.634651 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0fcc9d0c-68f0-49e2-9b7d-9e29b995c3bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:15.635396 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0fcc9d0c-68f0-49e2-9b7d-9e29b995c3bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:15.635854 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0fcc9d0c-68f0-49e2-9b7d-9e29b995c3bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:15.636545 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0fcc9d0c-68f0-49e2-9b7d-9e29b995c3bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:15.637010 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0fcc9d0c-68f0-49e2-9b7d-9e29b995c3bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:15.637434 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0fcc9d0c-68f0-49e2-9b7d-9e29b995c3bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:15.764483 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0fcc9d0c-68f0-49e2-9b7d-9e29b995c3bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:15.772878 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0fcc9d0c-68f0-49e2-9b7d-9e29b995c3bc tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1735 microversion: 2.1 time: 0.149130 Sep 14 01:11:15.773440 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 357/714] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:15 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:16.798375 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9bf7b51e-0309-4e55-96a3-94601a472330 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:16.798915 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9bf7b51e-0309-4e55-96a3-94601a472330 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:16.805423 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9bf7b51e-0309-4e55-96a3-94601a472330 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:16.805904 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9bf7b51e-0309-4e55-96a3-94601a472330 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:16.806345 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9bf7b51e-0309-4e55-96a3-94601a472330 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:16.807043 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9bf7b51e-0309-4e55-96a3-94601a472330 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:16.807498 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9bf7b51e-0309-4e55-96a3-94601a472330 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:16.807948 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9bf7b51e-0309-4e55-96a3-94601a472330 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:16.938582 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9bf7b51e-0309-4e55-96a3-94601a472330 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:16.946877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9bf7b51e-0309-4e55-96a3-94601a472330 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1735 microversion: 2.1 time: 0.152670 Sep 14 01:11:16.947439 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 358/715] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:16 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:17.970799 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-92f87eec-f26c-4d3e-8d6e-c97916629b87 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:17.971404 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-92f87eec-f26c-4d3e-8d6e-c97916629b87 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:17.977602 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-92f87eec-f26c-4d3e-8d6e-c97916629b87 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:17.978091 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-92f87eec-f26c-4d3e-8d6e-c97916629b87 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:17.979141 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-92f87eec-f26c-4d3e-8d6e-c97916629b87 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:17.979895 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-92f87eec-f26c-4d3e-8d6e-c97916629b87 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:17.980362 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-92f87eec-f26c-4d3e-8d6e-c97916629b87 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:17.980794 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-92f87eec-f26c-4d3e-8d6e-c97916629b87 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:18.110749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-92f87eec-f26c-4d3e-8d6e-c97916629b87 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:18.118966 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-92f87eec-f26c-4d3e-8d6e-c97916629b87 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1735 microversion: 2.1 time: 0.152221 Sep 14 01:11:18.119537 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 358/716] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:17 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:19.142806 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c3070a35-93e8-4213-b7e4-38689ad49854 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:19.143407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c3070a35-93e8-4213-b7e4-38689ad49854 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:19.145920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=32 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:19.152187 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c3070a35-93e8-4213-b7e4-38689ad49854 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:19.152669 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c3070a35-93e8-4213-b7e4-38689ad49854 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:19.153100 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c3070a35-93e8-4213-b7e4-38689ad49854 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:19.153783 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c3070a35-93e8-4213-b7e4-38689ad49854 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:19.154239 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c3070a35-93e8-4213-b7e4-38689ad49854 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:19.154657 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c3070a35-93e8-4213-b7e4-38689ad49854 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:19.284553 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c3070a35-93e8-4213-b7e4-38689ad49854 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:19.292625 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c3070a35-93e8-4213-b7e4-38689ad49854 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1735 microversion: 2.1 time: 0.153744 Sep 14 01:11:19.293185 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 359/717] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:19 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:20.317837 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-3463eeca-c0b0-4777-bc73-3d3211033763 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:20.318445 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-3463eeca-c0b0-4777-bc73-3d3211033763 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:20.325141 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3463eeca-c0b0-4777-bc73-3d3211033763 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:20.325622 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3463eeca-c0b0-4777-bc73-3d3211033763 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:20.326052 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3463eeca-c0b0-4777-bc73-3d3211033763 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:20.326733 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3463eeca-c0b0-4777-bc73-3d3211033763 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:20.327182 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3463eeca-c0b0-4777-bc73-3d3211033763 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:20.327629 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3463eeca-c0b0-4777-bc73-3d3211033763 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:20.461752 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-3463eeca-c0b0-4777-bc73-3d3211033763 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:20.470346 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-3463eeca-c0b0-4777-bc73-3d3211033763 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1735 microversion: 2.1 time: 0.157264 Sep 14 01:11:20.470915 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 359/718] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:20 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:21.501685 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c91add5c-ea45-422e-947a-a4c7a697058d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:21.502293 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c91add5c-ea45-422e-947a-a4c7a697058d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:21.508684 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c91add5c-ea45-422e-947a-a4c7a697058d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:21.509176 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c91add5c-ea45-422e-947a-a4c7a697058d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:21.509613 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c91add5c-ea45-422e-947a-a4c7a697058d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:21.510559 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c91add5c-ea45-422e-947a-a4c7a697058d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:21.511013 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c91add5c-ea45-422e-947a-a4c7a697058d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:21.511438 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c91add5c-ea45-422e-947a-a4c7a697058d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:21.641637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c91add5c-ea45-422e-947a-a4c7a697058d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:21.649839 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c91add5c-ea45-422e-947a-a4c7a697058d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1715 microversion: 2.1 time: 0.152669 Sep 14 01:11:21.650407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 360/719] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:21 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:21.761084 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-719d4458-3730-443e-943c-7ccd675105af tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:21.761600 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-719d4458-3730-443e-943c-7ccd675105af tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:21.768313 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-719d4458-3730-443e-943c-7ccd675105af tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:21.768797 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-719d4458-3730-443e-943c-7ccd675105af tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:21.769235 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-719d4458-3730-443e-943c-7ccd675105af tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:21.769926 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-719d4458-3730-443e-943c-7ccd675105af tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:21.770395 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-719d4458-3730-443e-943c-7ccd675105af tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:21.770837 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-719d4458-3730-443e-943c-7ccd675105af tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:21.845899 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:21.852609 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-719d4458-3730-443e-943c-7ccd675105af tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] HTTP exception thrown: Cannot 'detach_volume' instance 413d7106-fff0-4516-b70d-1d687312c9aa while it is in vm_state rescued Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-719d4458-3730-443e-943c-7ccd675105af tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Request method failure captured: Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: DELETE /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa/os-volume_attachments/de8dc9db-36c3-4686-b36f-5f3775282013 HTTP/1.1 Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISi4inilP69TsQy2mm8Nh_IJQUYwZWgS8ICnEm1cj-smaP8bvo3DYC3hiD1vyg0oqkoMty-SG5kNH82xGIxyRzyUFloa1yf9CprF8FrUKT4AVz69xJpjqpXzcwegWPCIyPFW48HXkwwHrds38MJBEzqTje22LXfjItqk1TH9fQ_CyxA Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: d1dd868f069a46dbb6bfd549f6bbf7b8 Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2000797838 Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:11:21.854210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:11:21.855681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1dd868f069a46dbb6bfd549f6bbf7b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1dd868f069a46dbb6bfd549f6bbf7b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1dd868f069a46dbb6bfd549f6bbf7b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1dd868f069a46dbb6bfd549f6bbf7b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:11:21.855681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2000797838 Sep 14 01:11:21.855681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: d1dd868f069a46dbb6bfd549f6bbf7b8 Sep 14 01:11:21.855681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2000797838 Sep 14 01:11:21.855681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-ServerRescueNegativeTestJSON-2000797838-project Sep 14 01:11:21.855681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:11:21.855681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:11:21.855681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: bf73eca572454b88843785d791f0b471 Sep 14 01:11:21.855681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2000797838-project Sep 14 01:11:21.855681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:11:21.855681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Cannot 'detach_volume' instance 413d7106-fff0-4516-b70d-1d687312c9aa while it is in vm_state rescued Sep 14 01:11:21.856380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'server_id': '413d7106-fff0-4516-b70d-1d687312c9aa', 'id': 'de8dc9db-36c3-4686-b36f-5f3775282013'} Sep 14 01:11:21.856380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:11:21.856380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:11:21.856380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 14 01:11:21.856380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 14 01:11:21.856380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 01:11:21.856380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 01:11:21.856380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 01:11:21.856380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 01:11:21.856380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 413d7106-fff0-4516-b70d-1d687312c9aa in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 14 01:11:21.856380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:11:21.856380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:11:21.856380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:11:21.856380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:11:21.856380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:11:21.856380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:11:21.856380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:11:21.856380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:11:21.856380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:11:21.856380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:11:21.857850 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 14 01:11:21.857850 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 01:11:21.857850 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 01:11:21.857850 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 01:11:21.857850 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 413d7106-fff0-4516-b70d-1d687312c9aa while it is in vm_state rescued Sep 14 01:11:21.857850 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:11:21.857850 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:11:21.857850 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:11:21.857850 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:11:21.857850 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:11:21.857850 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:11:21.857850 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:11:21.857850 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:11:21.857850 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 413d7106-fff0-4516-b70d-1d687312c9aa while it is in vm_state rescued Sep 14 01:11:21.857850 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:11:21.857850 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-719d4458-3730-443e-943c-7ccd675105af tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Returning 409 to user: Cannot 'detach_volume' instance 413d7106-fff0-4516-b70d-1d687312c9aa while it is in vm_state rescued {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:11:21.859219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-719d4458-3730-443e-943c-7ccd675105af tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "DELETE /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa/os-volume_attachments/de8dc9db-36c3-4686-b36f-5f3775282013" status: 409 len: 152 microversion: 2.1 time: 0.098876 Sep 14 01:11:21.859219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 360/720] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 01:11:21 2022] DELETE /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa/os-volume_attachments/de8dc9db-36c3-4686-b36f-5f3775282013 => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 01:11:21.864553 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-61e60698-3c6f-4bdb-a23e-e15618431550 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:11:21.865092 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-61e60698-3c6f-4bdb-a23e-e15618431550 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:21.870915 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-61e60698-3c6f-4bdb-a23e-e15618431550 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:21.871402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-61e60698-3c6f-4bdb-a23e-e15618431550 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:21.871878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-61e60698-3c6f-4bdb-a23e-e15618431550 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:21.872569 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-61e60698-3c6f-4bdb-a23e-e15618431550 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:21.873024 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-61e60698-3c6f-4bdb-a23e-e15618431550 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:21.873450 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-61e60698-3c6f-4bdb-a23e-e15618431550 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:21.939475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-61e60698-3c6f-4bdb-a23e-e15618431550 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "POST /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa/action" status: 202 len: 0 microversion: 2.1 time: 0.078518 Sep 14 01:11:21.943327 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 361/721] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 01:11:21 2022] POST /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:11:21.951547 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-180ebe5e-4092-408c-8517-ef368e5a8a8b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:21.952190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-180ebe5e-4092-408c-8517-ef368e5a8a8b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:21.960326 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-180ebe5e-4092-408c-8517-ef368e5a8a8b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:21.961092 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-180ebe5e-4092-408c-8517-ef368e5a8a8b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:21.961403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-180ebe5e-4092-408c-8517-ef368e5a8a8b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:21.962275 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-180ebe5e-4092-408c-8517-ef368e5a8a8b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:21.963051 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-180ebe5e-4092-408c-8517-ef368e5a8a8b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:21.963602 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-180ebe5e-4092-408c-8517-ef368e5a8a8b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:22.097365 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-180ebe5e-4092-408c-8517-ef368e5a8a8b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:22.105629 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-180ebe5e-4092-408c-8517-ef368e5a8a8b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1723 microversion: 2.1 time: 0.158501 Sep 14 01:11:22.106192 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 361/722] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:21 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:23.129999 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c63ed4bc-281b-49c5-9c97-d0de8b8ccf2d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:23.130685 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c63ed4bc-281b-49c5-9c97-d0de8b8ccf2d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:23.136957 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c63ed4bc-281b-49c5-9c97-d0de8b8ccf2d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:23.137431 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c63ed4bc-281b-49c5-9c97-d0de8b8ccf2d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:23.137898 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c63ed4bc-281b-49c5-9c97-d0de8b8ccf2d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:23.138571 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c63ed4bc-281b-49c5-9c97-d0de8b8ccf2d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:23.139021 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c63ed4bc-281b-49c5-9c97-d0de8b8ccf2d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:23.139440 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c63ed4bc-281b-49c5-9c97-d0de8b8ccf2d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:23.268555 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c63ed4bc-281b-49c5-9c97-d0de8b8ccf2d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:23.276705 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c63ed4bc-281b-49c5-9c97-d0de8b8ccf2d tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1723 microversion: 2.1 time: 0.151708 Sep 14 01:11:23.277256 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 362/723] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:23 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:24.300901 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2b43226f-e803-4c17-93fd-1aba5e35221c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:24.301543 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2b43226f-e803-4c17-93fd-1aba5e35221c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:24.308042 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2b43226f-e803-4c17-93fd-1aba5e35221c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:24.308533 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2b43226f-e803-4c17-93fd-1aba5e35221c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:24.308990 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2b43226f-e803-4c17-93fd-1aba5e35221c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:24.309675 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2b43226f-e803-4c17-93fd-1aba5e35221c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:24.310127 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2b43226f-e803-4c17-93fd-1aba5e35221c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:24.310548 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2b43226f-e803-4c17-93fd-1aba5e35221c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:24.441656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-2b43226f-e803-4c17-93fd-1aba5e35221c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:24.449738 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2b43226f-e803-4c17-93fd-1aba5e35221c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1723 microversion: 2.1 time: 0.153243 Sep 14 01:11:24.450294 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 362/724] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:24 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:25.472635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7c19b043-70e6-4ae0-a563-c94dd12f7e5f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:25.473442 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7c19b043-70e6-4ae0-a563-c94dd12f7e5f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:25.480075 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c19b043-70e6-4ae0-a563-c94dd12f7e5f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:25.480595 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c19b043-70e6-4ae0-a563-c94dd12f7e5f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:25.481062 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c19b043-70e6-4ae0-a563-c94dd12f7e5f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:25.481788 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c19b043-70e6-4ae0-a563-c94dd12f7e5f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:25.482411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c19b043-70e6-4ae0-a563-c94dd12f7e5f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:25.482651 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c19b043-70e6-4ae0-a563-c94dd12f7e5f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:25.616842 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7c19b043-70e6-4ae0-a563-c94dd12f7e5f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:25.625852 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7c19b043-70e6-4ae0-a563-c94dd12f7e5f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1723 microversion: 2.1 time: 0.156808 Sep 14 01:11:25.626445 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 363/725] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:25 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:26.541614 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d9a74621-1c6e-4353-937a-48df5fd1d6a1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:26.542177 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d9a74621-1c6e-4353-937a-48df5fd1d6a1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:26.549406 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d9a74621-1c6e-4353-937a-48df5fd1d6a1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:26.549891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d9a74621-1c6e-4353-937a-48df5fd1d6a1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:26.550328 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d9a74621-1c6e-4353-937a-48df5fd1d6a1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:26.551017 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d9a74621-1c6e-4353-937a-48df5fd1d6a1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:26.551472 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d9a74621-1c6e-4353-937a-48df5fd1d6a1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:26.551921 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d9a74621-1c6e-4353-937a-48df5fd1d6a1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:26.632543 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-d9a74621-1c6e-4353-937a-48df5fd1d6a1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lazy-loading 'services' on Instance uuid 5e701782-aa36-44dd-be23-a59054d8cb32 {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:11:26.649279 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-38b1e93c-5779-4aaf-8419-bb071dcdf9a2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:26.649902 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-38b1e93c-5779-4aaf-8419-bb071dcdf9a2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:26.657151 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-38b1e93c-5779-4aaf-8419-bb071dcdf9a2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:26.657647 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-38b1e93c-5779-4aaf-8419-bb071dcdf9a2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:26.658091 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-38b1e93c-5779-4aaf-8419-bb071dcdf9a2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:26.658795 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-38b1e93c-5779-4aaf-8419-bb071dcdf9a2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:26.659254 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-38b1e93c-5779-4aaf-8419-bb071dcdf9a2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:26.659713 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-38b1e93c-5779-4aaf-8419-bb071dcdf9a2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:26.707486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d9a74621-1c6e-4353-937a-48df5fd1d6a1 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32/os-volume_attachments/90afba07-ba11-495e-9daf-e9598cf17356" status: 202 len: 0 microversion: 2.1 time: 0.171944 Sep 14 01:11:26.708162 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 363/726] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 01:11:26 2022] DELETE /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32/os-volume_attachments/90afba07-ba11-495e-9daf-e9598cf17356 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:11:26.794752 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-38b1e93c-5779-4aaf-8419-bb071dcdf9a2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:26.803917 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-38b1e93c-5779-4aaf-8419-bb071dcdf9a2 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1729 microversion: 2.1 time: 0.158361 Sep 14 01:11:26.804356 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 364/727] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:26 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:11:26.827258 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-570db994-a097-4f13-b95f-4e3bcc6eacd4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:26.827875 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-570db994-a097-4f13-b95f-4e3bcc6eacd4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:26.834953 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-570db994-a097-4f13-b95f-4e3bcc6eacd4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:26.835464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-570db994-a097-4f13-b95f-4e3bcc6eacd4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:26.835923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-570db994-a097-4f13-b95f-4e3bcc6eacd4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:26.836608 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-570db994-a097-4f13-b95f-4e3bcc6eacd4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:26.837059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-570db994-a097-4f13-b95f-4e3bcc6eacd4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:26.837477 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-570db994-a097-4f13-b95f-4e3bcc6eacd4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:26.916668 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-570db994-a097-4f13-b95f-4e3bcc6eacd4 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093415 Sep 14 01:11:26.917330 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 364/728] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Sep 14 01:11:26 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:11:27.857649 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9b994fa7-5e54-48e3-83f1-316cd9024b27 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:11:27.859098 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-32b16fc1-fe8a-4de1-a7c4-27df15ad2cd8 req-978c1808-990e-40fc-80a2-333a5ff70c86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "413d7106-fff0-4516-b70d-1d687312c9aa", "tag": "41e3c7ae-c1a9-4785-bdec-300c125b2082"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:11:27.865732 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9b994fa7-5e54-48e3-83f1-316cd9024b27 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:27.866223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9b994fa7-5e54-48e3-83f1-316cd9024b27 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:27.866658 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9b994fa7-5e54-48e3-83f1-316cd9024b27 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:27.869533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-32b16fc1-fe8a-4de1-a7c4-27df15ad2cd8 req-978c1808-990e-40fc-80a2-333a5ff70c86 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:27.870223 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-32b16fc1-fe8a-4de1-a7c4-27df15ad2cd8 req-978c1808-990e-40fc-80a2-333a5ff70c86 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:27.871345 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-32b16fc1-fe8a-4de1-a7c4-27df15ad2cd8 req-978c1808-990e-40fc-80a2-333a5ff70c86 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:27.884006 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-32b16fc1-fe8a-4de1-a7c4-27df15ad2cd8 req-978c1808-990e-40fc-80a2-333a5ff70c86 service nova] Creating event network-changed:41e3c7ae-c1a9-4785-bdec-300c125b2082 for instance 413d7106-fff0-4516-b70d-1d687312c9aa on hv-cinder-85752 Sep 14 01:11:27.892005 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-32b16fc1-fe8a-4de1-a7c4-27df15ad2cd8 req-978c1808-990e-40fc-80a2-333a5ff70c86 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105167 Sep 14 01:11:27.892339 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9b994fa7-5e54-48e3-83f1-316cd9024b27 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Going to try to stop instance {{(pid=120620) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 01:11:27.893794 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 365/729] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:11:27.941384 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9b994fa7-5e54-48e3-83f1-316cd9024b27 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "POST /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32/action" status: 202 len: 0 microversion: 2.1 time: 0.088241 Sep 14 01:11:27.942157 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 365/730] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 01:11:27 2022] POST /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:11:27.950831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b587886e-949a-46b7-8c0b-c59d4909fe89 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:27.951681 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b587886e-949a-46b7-8c0b-c59d4909fe89 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:27.960218 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b587886e-949a-46b7-8c0b-c59d4909fe89 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:27.960815 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b587886e-949a-46b7-8c0b-c59d4909fe89 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:27.961670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b587886e-949a-46b7-8c0b-c59d4909fe89 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:27.963054 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b587886e-949a-46b7-8c0b-c59d4909fe89 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:27.964165 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b587886e-949a-46b7-8c0b-c59d4909fe89 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:27.964819 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b587886e-949a-46b7-8c0b-c59d4909fe89 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:28.123084 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b587886e-949a-46b7-8c0b-c59d4909fe89 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:28.131792 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b587886e-949a-46b7-8c0b-c59d4909fe89 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1675 microversion: 2.1 time: 0.185165 Sep 14 01:11:28.132983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 366/731] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:27 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:11:29.158626 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d097e34f-b996-4ce4-85ec-9b81fa66576e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:29.159324 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d097e34f-b996-4ce4-85ec-9b81fa66576e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:29.165431 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d097e34f-b996-4ce4-85ec-9b81fa66576e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:29.165906 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d097e34f-b996-4ce4-85ec-9b81fa66576e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:29.166345 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d097e34f-b996-4ce4-85ec-9b81fa66576e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:29.167023 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d097e34f-b996-4ce4-85ec-9b81fa66576e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:29.167470 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d097e34f-b996-4ce4-85ec-9b81fa66576e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:29.167914 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d097e34f-b996-4ce4-85ec-9b81fa66576e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:29.300865 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d097e34f-b996-4ce4-85ec-9b81fa66576e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:29.308555 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d097e34f-b996-4ce4-85ec-9b81fa66576e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1675 microversion: 2.1 time: 0.155578 Sep 14 01:11:29.309120 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 366/732] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:29 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:11:29.908679 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-5701aa7c-98b1-47db-bcfa-fb075df41ac5 req-d64e75fc-9ffd-44a0-a052-3078d461aca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "413d7106-fff0-4516-b70d-1d687312c9aa", "tag": "41e3c7ae-c1a9-4785-bdec-300c125b2082"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:11:29.918249 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-5701aa7c-98b1-47db-bcfa-fb075df41ac5 req-d64e75fc-9ffd-44a0-a052-3078d461aca3 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:29.918717 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-5701aa7c-98b1-47db-bcfa-fb075df41ac5 req-d64e75fc-9ffd-44a0-a052-3078d461aca3 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:29.919142 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-5701aa7c-98b1-47db-bcfa-fb075df41ac5 req-d64e75fc-9ffd-44a0-a052-3078d461aca3 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:29.930194 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-5701aa7c-98b1-47db-bcfa-fb075df41ac5 req-d64e75fc-9ffd-44a0-a052-3078d461aca3 service nova] Creating event network-changed:41e3c7ae-c1a9-4785-bdec-300c125b2082 for instance 413d7106-fff0-4516-b70d-1d687312c9aa on hv-cinder-85752 Sep 14 01:11:29.934861 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-5701aa7c-98b1-47db-bcfa-fb075df41ac5 req-d64e75fc-9ffd-44a0-a052-3078d461aca3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030347 Sep 14 01:11:29.935409 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 367/733] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:11:30.332238 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8144e751-3538-4eb1-85bb-7a273d4fe526 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:30.332886 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8144e751-3538-4eb1-85bb-7a273d4fe526 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:30.339059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8144e751-3538-4eb1-85bb-7a273d4fe526 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:30.339546 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8144e751-3538-4eb1-85bb-7a273d4fe526 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:30.340004 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8144e751-3538-4eb1-85bb-7a273d4fe526 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:30.340700 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8144e751-3538-4eb1-85bb-7a273d4fe526 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:30.341162 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8144e751-3538-4eb1-85bb-7a273d4fe526 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:30.341583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8144e751-3538-4eb1-85bb-7a273d4fe526 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:30.471245 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8144e751-3538-4eb1-85bb-7a273d4fe526 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:30.479791 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8144e751-3538-4eb1-85bb-7a273d4fe526 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1675 microversion: 2.1 time: 0.152045 Sep 14 01:11:30.480367 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 367/734] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:30 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:31.505091 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-70daed16-4bac-45e3-be17-72e9548d3e3c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:31.505812 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-70daed16-4bac-45e3-be17-72e9548d3e3c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:31.512204 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70daed16-4bac-45e3-be17-72e9548d3e3c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:31.512686 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70daed16-4bac-45e3-be17-72e9548d3e3c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:31.513118 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70daed16-4bac-45e3-be17-72e9548d3e3c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:31.513802 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70daed16-4bac-45e3-be17-72e9548d3e3c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:31.514255 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70daed16-4bac-45e3-be17-72e9548d3e3c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:31.514681 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-70daed16-4bac-45e3-be17-72e9548d3e3c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:31.642137 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-70daed16-4bac-45e3-be17-72e9548d3e3c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:31.649745 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-70daed16-4bac-45e3-be17-72e9548d3e3c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1675 microversion: 2.1 time: 0.149269 Sep 14 01:11:31.650308 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 368/735] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:31 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:32.673495 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-5f661fd3-7991-49a5-8053-3e65d1663e4a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:32.674102 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-5f661fd3-7991-49a5-8053-3e65d1663e4a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:32.680496 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5f661fd3-7991-49a5-8053-3e65d1663e4a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:32.680977 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5f661fd3-7991-49a5-8053-3e65d1663e4a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:32.681407 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5f661fd3-7991-49a5-8053-3e65d1663e4a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:32.682084 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5f661fd3-7991-49a5-8053-3e65d1663e4a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:32.682532 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5f661fd3-7991-49a5-8053-3e65d1663e4a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:32.682950 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5f661fd3-7991-49a5-8053-3e65d1663e4a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:32.810159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-5f661fd3-7991-49a5-8053-3e65d1663e4a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:32.818455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-5f661fd3-7991-49a5-8053-3e65d1663e4a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1675 microversion: 2.1 time: 0.149697 Sep 14 01:11:32.819015 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 368/736] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:32 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:11:33.841340 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-bf0cb8a2-ce31-474b-8071-7b7c36ca41d6 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:33.841874 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-bf0cb8a2-ce31-474b-8071-7b7c36ca41d6 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:33.849220 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bf0cb8a2-ce31-474b-8071-7b7c36ca41d6 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:33.849707 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bf0cb8a2-ce31-474b-8071-7b7c36ca41d6 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:33.850144 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bf0cb8a2-ce31-474b-8071-7b7c36ca41d6 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:33.850835 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bf0cb8a2-ce31-474b-8071-7b7c36ca41d6 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:33.851295 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bf0cb8a2-ce31-474b-8071-7b7c36ca41d6 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:33.851766 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bf0cb8a2-ce31-474b-8071-7b7c36ca41d6 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:33.983312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-bf0cb8a2-ce31-474b-8071-7b7c36ca41d6 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:33.994161 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-bf0cb8a2-ce31-474b-8071-7b7c36ca41d6 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1675 microversion: 2.1 time: 0.156644 Sep 14 01:11:33.994877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 369/737] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:33 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:35.019602 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-b673bb62-ec12-4560-9d79-5be7a76f54a2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:35.020216 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-b673bb62-ec12-4560-9d79-5be7a76f54a2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:35.026685 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b673bb62-ec12-4560-9d79-5be7a76f54a2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:35.027170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b673bb62-ec12-4560-9d79-5be7a76f54a2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:35.027631 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b673bb62-ec12-4560-9d79-5be7a76f54a2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:35.028318 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b673bb62-ec12-4560-9d79-5be7a76f54a2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:35.028775 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b673bb62-ec12-4560-9d79-5be7a76f54a2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:35.029199 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b673bb62-ec12-4560-9d79-5be7a76f54a2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:35.158495 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b673bb62-ec12-4560-9d79-5be7a76f54a2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:35.166068 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-b673bb62-ec12-4560-9d79-5be7a76f54a2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1675 microversion: 2.1 time: 0.150429 Sep 14 01:11:35.166622 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 369/738] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:35 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:36.189710 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0c61dd75-4752-43f4-8714-f0c6d73196c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:36.190317 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0c61dd75-4752-43f4-8714-f0c6d73196c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:36.196836 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0c61dd75-4752-43f4-8714-f0c6d73196c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:36.197316 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0c61dd75-4752-43f4-8714-f0c6d73196c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:36.197746 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0c61dd75-4752-43f4-8714-f0c6d73196c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:36.198436 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0c61dd75-4752-43f4-8714-f0c6d73196c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:36.198882 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0c61dd75-4752-43f4-8714-f0c6d73196c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:36.199305 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0c61dd75-4752-43f4-8714-f0c6d73196c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:36.328199 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0c61dd75-4752-43f4-8714-f0c6d73196c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:36.335913 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0c61dd75-4752-43f4-8714-f0c6d73196c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1675 microversion: 2.1 time: 0.150330 Sep 14 01:11:36.336478 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 370/739] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:36 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:37.359621 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-29d3c118-d3f2-420b-9c14-47bcf66d64ae tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:37.360303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-29d3c118-d3f2-420b-9c14-47bcf66d64ae tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:37.362764 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=34 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:37.368202 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-29d3c118-d3f2-420b-9c14-47bcf66d64ae tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:37.368694 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-29d3c118-d3f2-420b-9c14-47bcf66d64ae tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:37.369133 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-29d3c118-d3f2-420b-9c14-47bcf66d64ae tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:37.369824 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-29d3c118-d3f2-420b-9c14-47bcf66d64ae tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:37.370277 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-29d3c118-d3f2-420b-9c14-47bcf66d64ae tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:37.370722 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-29d3c118-d3f2-420b-9c14-47bcf66d64ae tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:37.525897 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-29d3c118-d3f2-420b-9c14-47bcf66d64ae tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:37.534523 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-29d3c118-d3f2-420b-9c14-47bcf66d64ae tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1675 microversion: 2.1 time: 0.179147 Sep 14 01:11:37.535480 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 370/740] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:37 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:38.558953 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7547b4f5-2a61-4f4f-8714-fc775287deb9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:38.559539 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7547b4f5-2a61-4f4f-8714-fc775287deb9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:38.566245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7547b4f5-2a61-4f4f-8714-fc775287deb9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:38.566726 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7547b4f5-2a61-4f4f-8714-fc775287deb9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:38.567161 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7547b4f5-2a61-4f4f-8714-fc775287deb9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:38.567880 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7547b4f5-2a61-4f4f-8714-fc775287deb9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:38.568397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7547b4f5-2a61-4f4f-8714-fc775287deb9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:38.568817 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7547b4f5-2a61-4f4f-8714-fc775287deb9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:38.701338 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7547b4f5-2a61-4f4f-8714-fc775287deb9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:38.705298 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:38.710652 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7547b4f5-2a61-4f4f-8714-fc775287deb9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1675 microversion: 2.1 time: 0.155647 Sep 14 01:11:38.711211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 371/741] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:38 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:39.733257 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7d244bc9-420b-436b-af4f-6bae32d2eaf5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:39.734073 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7d244bc9-420b-436b-af4f-6bae32d2eaf5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:39.740990 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7d244bc9-420b-436b-af4f-6bae32d2eaf5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:39.741470 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7d244bc9-420b-436b-af4f-6bae32d2eaf5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:39.741899 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7d244bc9-420b-436b-af4f-6bae32d2eaf5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:39.742583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7d244bc9-420b-436b-af4f-6bae32d2eaf5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:39.743031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7d244bc9-420b-436b-af4f-6bae32d2eaf5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:39.743452 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7d244bc9-420b-436b-af4f-6bae32d2eaf5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:39.876581 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7d244bc9-420b-436b-af4f-6bae32d2eaf5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:39.884206 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7d244bc9-420b-436b-af4f-6bae32d2eaf5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1675 microversion: 2.1 time: 0.154827 Sep 14 01:11:39.885024 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 371/742] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:39 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:40.908847 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c6e1cc10-7238-40a7-a51d-fa8d2bab3c4a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:40.909393 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c6e1cc10-7238-40a7-a51d-fa8d2bab3c4a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:40.916809 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c6e1cc10-7238-40a7-a51d-fa8d2bab3c4a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:40.917290 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c6e1cc10-7238-40a7-a51d-fa8d2bab3c4a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:40.917721 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c6e1cc10-7238-40a7-a51d-fa8d2bab3c4a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:40.918400 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c6e1cc10-7238-40a7-a51d-fa8d2bab3c4a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:40.918848 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c6e1cc10-7238-40a7-a51d-fa8d2bab3c4a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:40.919269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c6e1cc10-7238-40a7-a51d-fa8d2bab3c4a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:41.050430 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c6e1cc10-7238-40a7-a51d-fa8d2bab3c4a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:41.058160 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c6e1cc10-7238-40a7-a51d-fa8d2bab3c4a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1675 microversion: 2.1 time: 0.154082 Sep 14 01:11:41.058750 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 372/743] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:40 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:42.084131 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-72adf1b3-22cc-4d57-b432-c6fafa2f8ab5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:42.084740 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-72adf1b3-22cc-4d57-b432-c6fafa2f8ab5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:42.091051 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-72adf1b3-22cc-4d57-b432-c6fafa2f8ab5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:42.091536 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-72adf1b3-22cc-4d57-b432-c6fafa2f8ab5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:42.092003 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-72adf1b3-22cc-4d57-b432-c6fafa2f8ab5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:42.092696 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-72adf1b3-22cc-4d57-b432-c6fafa2f8ab5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:42.093148 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-72adf1b3-22cc-4d57-b432-c6fafa2f8ab5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:42.093574 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-72adf1b3-22cc-4d57-b432-c6fafa2f8ab5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:42.220516 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-72adf1b3-22cc-4d57-b432-c6fafa2f8ab5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:42.228169 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-72adf1b3-22cc-4d57-b432-c6fafa2f8ab5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1675 microversion: 2.1 time: 0.147904 Sep 14 01:11:42.229041 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 372/744] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:42 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:43.253719 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-acb92042-69d0-457b-8975-0618a4db51a5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:43.254323 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-acb92042-69d0-457b-8975-0618a4db51a5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:43.260931 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-acb92042-69d0-457b-8975-0618a4db51a5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:43.261401 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-acb92042-69d0-457b-8975-0618a4db51a5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:43.261826 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-acb92042-69d0-457b-8975-0618a4db51a5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:43.262499 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-acb92042-69d0-457b-8975-0618a4db51a5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:43.262944 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-acb92042-69d0-457b-8975-0618a4db51a5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:43.263361 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-acb92042-69d0-457b-8975-0618a4db51a5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:43.393190 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-acb92042-69d0-457b-8975-0618a4db51a5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:43.400747 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-acb92042-69d0-457b-8975-0618a4db51a5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1675 microversion: 2.1 time: 0.151864 Sep 14 01:11:43.401306 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 373/745] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:43 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:44.423836 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-837b8de3-5ff7-41ed-936d-18b9e0ad26f4 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:44.424471 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-837b8de3-5ff7-41ed-936d-18b9e0ad26f4 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:44.430961 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-837b8de3-5ff7-41ed-936d-18b9e0ad26f4 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:44.431438 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-837b8de3-5ff7-41ed-936d-18b9e0ad26f4 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:44.431897 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-837b8de3-5ff7-41ed-936d-18b9e0ad26f4 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:44.432576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-837b8de3-5ff7-41ed-936d-18b9e0ad26f4 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:44.433025 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-837b8de3-5ff7-41ed-936d-18b9e0ad26f4 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:44.433443 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-837b8de3-5ff7-41ed-936d-18b9e0ad26f4 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:44.559644 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-837b8de3-5ff7-41ed-936d-18b9e0ad26f4 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:44.568172 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-837b8de3-5ff7-41ed-936d-18b9e0ad26f4 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1675 microversion: 2.1 time: 0.149067 Sep 14 01:11:44.568724 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 373/746] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:44 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:45.591507 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1bfdb190-7fcd-4a52-b676-c8ba04006b33 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:45.592139 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1bfdb190-7fcd-4a52-b676-c8ba04006b33 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:45.598824 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1bfdb190-7fcd-4a52-b676-c8ba04006b33 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:45.599304 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1bfdb190-7fcd-4a52-b676-c8ba04006b33 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:45.599770 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1bfdb190-7fcd-4a52-b676-c8ba04006b33 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:45.600454 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1bfdb190-7fcd-4a52-b676-c8ba04006b33 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:45.600900 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1bfdb190-7fcd-4a52-b676-c8ba04006b33 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:45.601316 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1bfdb190-7fcd-4a52-b676-c8ba04006b33 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:45.731499 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1bfdb190-7fcd-4a52-b676-c8ba04006b33 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:45.739327 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1bfdb190-7fcd-4a52-b676-c8ba04006b33 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1675 microversion: 2.1 time: 0.151637 Sep 14 01:11:45.740022 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 374/747] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:45 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:46.609950 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2c3a01cf-08ae-4600-9cac-a13a429501ae tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:46.610487 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2c3a01cf-08ae-4600-9cac-a13a429501ae tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:46.619971 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2c3a01cf-08ae-4600-9cac-a13a429501ae tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:46.620458 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2c3a01cf-08ae-4600-9cac-a13a429501ae tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:46.620893 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2c3a01cf-08ae-4600-9cac-a13a429501ae tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:46.621681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2c3a01cf-08ae-4600-9cac-a13a429501ae tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:46.622195 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2c3a01cf-08ae-4600-9cac-a13a429501ae tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:46.622632 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2c3a01cf-08ae-4600-9cac-a13a429501ae tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:46.646425 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2c3a01cf-08ae-4600-9cac-a13a429501ae tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e/ips" status: 200 len: 150 microversion: 2.1 time: 0.041203 Sep 14 01:11:46.646980 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 374/748] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Sep 14 01:11:46 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:11:46.659223 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fbb60217-183d-48a8-ac99-9102cbb2e31b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ad2c6bf-fcdd-46fb-8adc-6122188ced6b"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:11:46.661630 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fbb60217-183d-48a8-ac99-9102cbb2e31b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:46.668030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fbb60217-183d-48a8-ac99-9102cbb2e31b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:46.668519 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fbb60217-183d-48a8-ac99-9102cbb2e31b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:46.668952 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fbb60217-183d-48a8-ac99-9102cbb2e31b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:46.669638 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fbb60217-183d-48a8-ac99-9102cbb2e31b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:46.670092 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fbb60217-183d-48a8-ac99-9102cbb2e31b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:46.670515 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fbb60217-183d-48a8-ac99-9102cbb2e31b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:46.750838 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-fbb60217-183d-48a8-ac99-9102cbb2e31b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] HTTP exception thrown: Invalid volume: volume 1ad2c6bf-fcdd-46fb-8adc-6122188ced6b is already attached to instances: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fbb60217-183d-48a8-ac99-9102cbb2e31b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Request method failure captured: Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: POST /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e/os-volume_attachments HTTP/1.1 Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 74 Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISi3fXiNfssV-9suzyOi_X569sc3LzFc1vlFMuwkYOTf31lKxNzFY-VkibuUEPaC7Cvi81CQQfr4-r5n6Uvso8OzNo7bKIe7TyRgCLDNh1PVRJBuibEZ3mG6c00LHLtCWy0Oxl5Ip8Qv9iueHnKypM6PjqQ0qUH7793Mq_rFlqjqMYA Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:11:46.752601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:11:46.754321 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:11:46.754321 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:11:46.754321 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:11:46.754321 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:11:46.754321 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:11:46.754321 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:11:46.754321 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:11:46.754321 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: 51768890f19140b6819ef89f5bf610c8 Sep 14 01:11:46.754321 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:11:46.754321 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Sep 14 01:11:46.754321 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {"volumeAttachment": {"volumeId": "1ad2c6bf-fcdd-46fb-8adc-6122188ced6b"}} Sep 14 01:11:46.754321 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:11:46.755291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Invalid volume: volume 1ad2c6bf-fcdd-46fb-8adc-6122188ced6b is already attached to instances: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a Sep 14 01:11:46.755291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'server_id': '09c7d241-afe4-4cee-a009-fa481d6abe5e', 'body': {'volumeAttachment': {'volumeId': '1ad2c6bf-fcdd-46fb-8adc-6122188ced6b'}}} Sep 14 01:11:46.755291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:11:46.755291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:11:46.755291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 14 01:11:46.755291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 14 01:11:46.755291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 01:11:46.755291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 01:11:46.755291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 14 01:11:46.755291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 01:11:46.755291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 14 01:11:46.755291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 14 01:11:46.755291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 14 01:11:46.755291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 14 01:11:46.755291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1ad2c6bf-fcdd-46fb-8adc-6122188ced6b is already attached to instances: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a Sep 14 01:11:46.755291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:11:46.755291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:11:46.755291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:11:46.755291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:11:46.756878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:11:46.756878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:11:46.756878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:11:46.756878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:11:46.756878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:11:46.756878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:11:46.756878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 01:11:46.756878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 01:11:46.756878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 01:11:46.756878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 01:11:46.756878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 01:11:46.756878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 01:11:46.756878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 14 01:11:46.756878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 14 01:11:46.756878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1ad2c6bf-fcdd-46fb-8adc-6122188ced6b is already attached to instances: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a Sep 14 01:11:46.756878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:11:46.756878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:11:46.756878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:11:46.756878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:11:46.756878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:11:46.758524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:11:46.758524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:11:46.758524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:11:46.758524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1ad2c6bf-fcdd-46fb-8adc-6122188ced6b is already attached to instances: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a Sep 14 01:11:46.758524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:11:46.758524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fbb60217-183d-48a8-ac99-9102cbb2e31b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Returning 400 to user: Invalid volume: volume 1ad2c6bf-fcdd-46fb-8adc-6122188ced6b is already attached to instances: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:11:46.758524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fbb60217-183d-48a8-ac99-9102cbb2e31b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "POST /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099556 Sep 14 01:11:46.758524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 375/749] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 01:11:46 2022] POST /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 14 01:11:46.762939 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-46ba2180-b9a4-40be-8d55-4bbfba3660ea tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:46.763125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-613f04d9-ad69-49dd-a2f1-cc26f9f5b208 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:46.763476 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-613f04d9-ad69-49dd-a2f1-cc26f9f5b208 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:46.763603 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-46ba2180-b9a4-40be-8d55-4bbfba3660ea tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:46.769780 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-46ba2180-b9a4-40be-8d55-4bbfba3660ea tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:46.770191 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-613f04d9-ad69-49dd-a2f1-cc26f9f5b208 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:46.770315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-46ba2180-b9a4-40be-8d55-4bbfba3660ea tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:46.770685 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-46ba2180-b9a4-40be-8d55-4bbfba3660ea tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:46.770846 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-613f04d9-ad69-49dd-a2f1-cc26f9f5b208 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:46.771198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-613f04d9-ad69-49dd-a2f1-cc26f9f5b208 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:46.771366 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-46ba2180-b9a4-40be-8d55-4bbfba3660ea tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:46.771847 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-46ba2180-b9a4-40be-8d55-4bbfba3660ea tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:46.771961 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-613f04d9-ad69-49dd-a2f1-cc26f9f5b208 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:46.772267 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-46ba2180-b9a4-40be-8d55-4bbfba3660ea tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:46.772383 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-613f04d9-ad69-49dd-a2f1-cc26f9f5b208 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:46.772821 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-613f04d9-ad69-49dd-a2f1-cc26f9f5b208 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:46.798763 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-613f04d9-ad69-49dd-a2f1-cc26f9f5b208 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Going to try to terminate instance {{(pid=120621) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:11:46.878613 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-613f04d9-ad69-49dd-a2f1-cc26f9f5b208 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "DELETE /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 204 len: 0 microversion: 2.1 time: 0.119231 Sep 14 01:11:46.879525 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 376/750] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:11:46 2022] DELETE /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 01:11:46.888709 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a60c0c1e-001c-4bf7-b6e2-6f84c2717a5b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:46.889997 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a60c0c1e-001c-4bf7-b6e2-6f84c2717a5b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:46.896024 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a60c0c1e-001c-4bf7-b6e2-6f84c2717a5b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:46.896506 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a60c0c1e-001c-4bf7-b6e2-6f84c2717a5b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:46.896942 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a60c0c1e-001c-4bf7-b6e2-6f84c2717a5b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:46.897640 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a60c0c1e-001c-4bf7-b6e2-6f84c2717a5b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:46.898086 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a60c0c1e-001c-4bf7-b6e2-6f84c2717a5b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:46.898504 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a60c0c1e-001c-4bf7-b6e2-6f84c2717a5b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:46.916523 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-46ba2180-b9a4-40be-8d55-4bbfba3660ea tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:46.924372 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-46ba2180-b9a4-40be-8d55-4bbfba3660ea tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1675 microversion: 2.1 time: 0.165387 Sep 14 01:11:46.925071 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 375/751] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:46 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:47.029344 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a60c0c1e-001c-4bf7-b6e2-6f84c2717a5b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:47.037720 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a60c0c1e-001c-4bf7-b6e2-6f84c2717a5b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1678 microversion: 2.1 time: 0.153764 Sep 14 01:11:47.038282 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 377/752] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:46 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:47.947883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-441e62ff-0bf6-4464-a30c-86d173684242 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:47.948491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-441e62ff-0bf6-4464-a30c-86d173684242 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:47.955350 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-441e62ff-0bf6-4464-a30c-86d173684242 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:47.955861 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-441e62ff-0bf6-4464-a30c-86d173684242 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:47.956294 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-441e62ff-0bf6-4464-a30c-86d173684242 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:47.956975 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-441e62ff-0bf6-4464-a30c-86d173684242 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:47.957421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-441e62ff-0bf6-4464-a30c-86d173684242 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:47.957837 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-441e62ff-0bf6-4464-a30c-86d173684242 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:47.973260 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:48.061526 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-53513898-b950-421f-9980-ee4711480de2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:48.062567 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-53513898-b950-421f-9980-ee4711480de2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:48.069121 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53513898-b950-421f-9980-ee4711480de2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:48.069673 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53513898-b950-421f-9980-ee4711480de2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:48.070170 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53513898-b950-421f-9980-ee4711480de2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:48.070923 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53513898-b950-421f-9980-ee4711480de2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:48.071442 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53513898-b950-421f-9980-ee4711480de2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:48.071960 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53513898-b950-421f-9980-ee4711480de2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:48.091241 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-441e62ff-0bf6-4464-a30c-86d173684242 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:48.099640 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-441e62ff-0bf6-4464-a30c-86d173684242 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1675 microversion: 2.1 time: 0.155588 Sep 14 01:11:48.100242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 376/753] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:47 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:48.208821 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-53513898-b950-421f-9980-ee4711480de2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:48.216590 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-53513898-b950-421f-9980-ee4711480de2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1678 microversion: 2.1 time: 0.159099 Sep 14 01:11:48.217136 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 378/754] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:48 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:11:49.122460 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-238d1b26-9dd2-4501-ad64-e489ba12462b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:49.123165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-238d1b26-9dd2-4501-ad64-e489ba12462b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:49.129852 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-238d1b26-9dd2-4501-ad64-e489ba12462b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:49.130425 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-238d1b26-9dd2-4501-ad64-e489ba12462b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:49.130924 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-238d1b26-9dd2-4501-ad64-e489ba12462b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:49.131709 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-238d1b26-9dd2-4501-ad64-e489ba12462b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:49.132229 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-238d1b26-9dd2-4501-ad64-e489ba12462b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:49.132719 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-238d1b26-9dd2-4501-ad64-e489ba12462b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:49.240513 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d30f974c-d798-4850-a306-5c8a522a1b91 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:49.241227 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d30f974c-d798-4850-a306-5c8a522a1b91 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:49.243924 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:49.250657 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d30f974c-d798-4850-a306-5c8a522a1b91 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:49.251364 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d30f974c-d798-4850-a306-5c8a522a1b91 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:49.251930 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d30f974c-d798-4850-a306-5c8a522a1b91 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:49.252665 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d30f974c-d798-4850-a306-5c8a522a1b91 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:49.253127 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d30f974c-d798-4850-a306-5c8a522a1b91 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:49.253557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d30f974c-d798-4850-a306-5c8a522a1b91 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:49.269879 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-238d1b26-9dd2-4501-ad64-e489ba12462b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:49.278440 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-238d1b26-9dd2-4501-ad64-e489ba12462b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1652 microversion: 2.1 time: 0.159744 Sep 14 01:11:49.290899 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 377/755] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:49 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1652 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:49.301380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0fbfaa12-3fd1-4b20-b836-d8476eaf460c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:11:49.307452 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0fbfaa12-3fd1-4b20-b836-d8476eaf460c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:49.308032 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0fbfaa12-3fd1-4b20-b836-d8476eaf460c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:49.308438 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0fbfaa12-3fd1-4b20-b836-d8476eaf460c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:49.333219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0fbfaa12-3fd1-4b20-b836-d8476eaf460c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Going to try to start instance {{(pid=120620) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 14 01:11:49.376125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0fbfaa12-3fd1-4b20-b836-d8476eaf460c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "POST /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32/action" status: 202 len: 0 microversion: 2.1 time: 0.078554 Sep 14 01:11:49.379799 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 378/756] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 01:11:49 2022] POST /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 01:11:49.385582 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-14a13fc7-3b01-4aa2-9f66-fc9f2f183dce tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:49.386288 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-14a13fc7-3b01-4aa2-9f66-fc9f2f183dce tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:49.392939 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-14a13fc7-3b01-4aa2-9f66-fc9f2f183dce tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:49.393432 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-14a13fc7-3b01-4aa2-9f66-fc9f2f183dce tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:49.393868 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-14a13fc7-3b01-4aa2-9f66-fc9f2f183dce tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:49.394577 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-14a13fc7-3b01-4aa2-9f66-fc9f2f183dce tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:49.395035 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-14a13fc7-3b01-4aa2-9f66-fc9f2f183dce tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:49.395462 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-14a13fc7-3b01-4aa2-9f66-fc9f2f183dce tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:49.528332 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d30f974c-d798-4850-a306-5c8a522a1b91 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:49.546421 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d30f974c-d798-4850-a306-5c8a522a1b91 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1678 microversion: 2.1 time: 0.309699 Sep 14 01:11:49.547101 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 379/757] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:49 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1678 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:11:49.583225 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-14a13fc7-3b01-4aa2-9f66-fc9f2f183dce tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:49.591516 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-14a13fc7-3b01-4aa2-9f66-fc9f2f183dce tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1661 microversion: 2.1 time: 0.210258 Sep 14 01:11:49.592134 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 379/758] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:49 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1661 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:50.171286 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-67c16c99-fc23-4121-9c35-09476557d5e0 req-7868eaac-90e1-42d5-a6fc-a850d3474c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c7d241-afe4-4cee-a009-fa481d6abe5e", "name": "network-vif-deleted", "tag": "11bcbd99-dcf9-4ee8-ae91-4d0de4546447"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:11:50.186251 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-67c16c99-fc23-4121-9c35-09476557d5e0 req-7868eaac-90e1-42d5-a6fc-a850d3474c9a service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:50.187049 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-67c16c99-fc23-4121-9c35-09476557d5e0 req-7868eaac-90e1-42d5-a6fc-a850d3474c9a service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:50.187784 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-67c16c99-fc23-4121-9c35-09476557d5e0 req-7868eaac-90e1-42d5-a6fc-a850d3474c9a service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:50.205168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-67c16c99-fc23-4121-9c35-09476557d5e0 req-7868eaac-90e1-42d5-a6fc-a850d3474c9a service nova] Creating event network-vif-deleted:11bcbd99-dcf9-4ee8-ae91-4d0de4546447 for instance 09c7d241-afe4-4cee-a009-fa481d6abe5e on hv-cinder-85752 Sep 14 01:11:50.213392 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-67c16c99-fc23-4121-9c35-09476557d5e0 req-7868eaac-90e1-42d5-a6fc-a850d3474c9a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124101 Sep 14 01:11:50.226036 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 380/759] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:11:50.570846 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8032da4e-77d6-46ad-9803-b44e23a63106 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:50.572194 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8032da4e-77d6-46ad-9803-b44e23a63106 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:50.579589 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8032da4e-77d6-46ad-9803-b44e23a63106 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:50.580451 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8032da4e-77d6-46ad-9803-b44e23a63106 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:50.581254 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8032da4e-77d6-46ad-9803-b44e23a63106 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:50.582249 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8032da4e-77d6-46ad-9803-b44e23a63106 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:50.582928 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8032da4e-77d6-46ad-9803-b44e23a63106 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:50.583705 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8032da4e-77d6-46ad-9803-b44e23a63106 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:50.617951 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b9baa42f-625c-4b36-9e83-084ee9720acc tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:50.619872 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b9baa42f-625c-4b36-9e83-084ee9720acc tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:50.640286 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b9baa42f-625c-4b36-9e83-084ee9720acc tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:50.641275 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b9baa42f-625c-4b36-9e83-084ee9720acc tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:50.641950 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b9baa42f-625c-4b36-9e83-084ee9720acc tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:50.642902 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b9baa42f-625c-4b36-9e83-084ee9720acc tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:50.645128 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b9baa42f-625c-4b36-9e83-084ee9720acc tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:50.647589 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b9baa42f-625c-4b36-9e83-084ee9720acc tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:50.654910 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8032da4e-77d6-46ad-9803-b44e23a63106 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:50.659156 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8032da4e-77d6-46ad-9803-b44e23a63106 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:50.660000 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8032da4e-77d6-46ad-9803-b44e23a63106 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:50.661337 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-8032da4e-77d6-46ad-9803-b44e23a63106 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lazy-loading 'fault' on Instance uuid 09c7d241-afe4-4cee-a009-fa481d6abe5e {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:11:50.733724 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8032da4e-77d6-46ad-9803-b44e23a63106 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:50.742100 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8032da4e-77d6-46ad-9803-b44e23a63106 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1330 microversion: 2.1 time: 0.175806 Sep 14 01:11:50.743282 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 380/760] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:50 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1330 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:50.859049 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b9baa42f-625c-4b36-9e83-084ee9720acc tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:50.867458 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b9baa42f-625c-4b36-9e83-084ee9720acc tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1661 microversion: 2.1 time: 0.255292 Sep 14 01:11:50.871617 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 381/761] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:50 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1661 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:11:51.766268 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9edb6481-829f-43bb-ab3c-414407984424 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:51.767036 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9edb6481-829f-43bb-ab3c-414407984424 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:51.774061 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9edb6481-829f-43bb-ab3c-414407984424 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:51.774878 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9edb6481-829f-43bb-ab3c-414407984424 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:51.775502 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9edb6481-829f-43bb-ab3c-414407984424 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:51.776652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9edb6481-829f-43bb-ab3c-414407984424 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:51.777134 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9edb6481-829f-43bb-ab3c-414407984424 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:51.777563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9edb6481-829f-43bb-ab3c-414407984424 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:51.811144 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9edb6481-829f-43bb-ab3c-414407984424 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:51.811923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9edb6481-829f-43bb-ab3c-414407984424 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:51.812360 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9edb6481-829f-43bb-ab3c-414407984424 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:51.812814 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-9edb6481-829f-43bb-ab3c-414407984424 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lazy-loading 'fault' on Instance uuid 09c7d241-afe4-4cee-a009-fa481d6abe5e {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:11:51.859997 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9edb6481-829f-43bb-ab3c-414407984424 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:51.867068 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9edb6481-829f-43bb-ab3c-414407984424 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 200 len: 1330 microversion: 2.1 time: 0.104941 Sep 14 01:11:51.867655 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 381/762] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:51 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:11:51.891537 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-12da083e-c06c-420e-a6f3-4bf2ca57563e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:51.892102 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-12da083e-c06c-420e-a6f3-4bf2ca57563e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:51.898485 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12da083e-c06c-420e-a6f3-4bf2ca57563e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:51.898970 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12da083e-c06c-420e-a6f3-4bf2ca57563e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:51.899409 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12da083e-c06c-420e-a6f3-4bf2ca57563e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:51.900114 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12da083e-c06c-420e-a6f3-4bf2ca57563e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:51.900571 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12da083e-c06c-420e-a6f3-4bf2ca57563e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:51.900994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-12da083e-c06c-420e-a6f3-4bf2ca57563e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:52.035235 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-12da083e-c06c-420e-a6f3-4bf2ca57563e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:52.043205 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-12da083e-c06c-420e-a6f3-4bf2ca57563e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1665 microversion: 2.1 time: 0.155606 Sep 14 01:11:52.044168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 382/763] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:51 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:52.890667 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-aca29124-dff8-45a1-96c5-f46e8207bf63 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:52.891257 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-aca29124-dff8-45a1-96c5-f46e8207bf63 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:52.897691 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aca29124-dff8-45a1-96c5-f46e8207bf63 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:52.898177 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aca29124-dff8-45a1-96c5-f46e8207bf63 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:52.898618 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aca29124-dff8-45a1-96c5-f46e8207bf63 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:52.899305 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aca29124-dff8-45a1-96c5-f46e8207bf63 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:52.899791 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aca29124-dff8-45a1-96c5-f46e8207bf63 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:52.900218 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aca29124-dff8-45a1-96c5-f46e8207bf63 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:52.913864 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-aca29124-dff8-45a1-96c5-f46e8207bf63 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] HTTP exception thrown: Instance 09c7d241-afe4-4cee-a009-fa481d6abe5e could not be found. Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-aca29124-dff8-45a1-96c5-f46e8207bf63 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Request method failure captured: Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e HTTP/1.1 Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISi3fXiNfssV-9suzyOi_X569sc3LzFc1vlFMuwkYOTf31lKxNzFY-VkibuUEPaC7Cvi81CQQfr4-r5n6Uvso8OzNo7bKIe7TyRgCLDNh1PVRJBuibEZ3mG6c00LHLtCWy0Oxl5Ip8Qv9iueHnKypM6PjqQ0qUH7793Mq_rFlqjqMYA Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:11:52.915482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:11:52.917058 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:11:52.917058 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:11:52.917058 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:11:52.917058 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:11:52.917058 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:11:52.917058 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:11:52.917058 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:11:52.917058 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: 51768890f19140b6819ef89f5bf610c8 Sep 14 01:11:52.917058 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:11:52.917058 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:11:52.917058 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance 09c7d241-afe4-4cee-a009-fa481d6abe5e could not be found. Sep 14 01:11:52.917058 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': '09c7d241-afe4-4cee-a009-fa481d6abe5e'} Sep 14 01:11:52.917957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:11:52.917957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:11:52.917957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:11:52.917957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:11:52.917957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:11:52.917957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:11:52.917957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:11:52.917957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:11:52.917957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:11:52.917957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:11:52.917957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09c7d241-afe4-4cee-a009-fa481d6abe5e could not be found. Sep 14 01:11:52.917957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:11:52.917957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:11:52.917957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:11:52.917957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:11:52.917957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:11:52.917957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:11:52.917957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:11:52.917957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:11:52.917957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:11:52.919476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:11:52.919476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:11:52.919476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:11:52.919476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:11:52.919476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:11:52.919476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:11:52.919476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:11:52.919476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09c7d241-afe4-4cee-a009-fa481d6abe5e could not be found. Sep 14 01:11:52.919476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:11:52.919476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:11:52.919476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:11:52.919476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:11:52.919476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:11:52.919476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:11:52.919476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:11:52.919476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:11:52.919476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09c7d241-afe4-4cee-a009-fa481d6abe5e could not be found. Sep 14 01:11:52.919476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:11:52.921087 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-aca29124-dff8-45a1-96c5-f46e8207bf63 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Returning 404 to user: Instance 09c7d241-afe4-4cee-a009-fa481d6abe5e could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:11:52.921087 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-aca29124-dff8-45a1-96c5-f46e8207bf63 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 404 len: 111 microversion: 2.1 time: 0.030800 Sep 14 01:11:52.921087 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 382/764] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:52 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:11:52.925558 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-94d4920f-dbf6-47f0-90d3-acd5153e9a75 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '.version_select at 0x7f5043d0f790>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:52.929995 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR oslo.messaging._drivers.impl_rabbit [None req-94d4920f-dbf6-47f0-90d3-acd5153e9a75 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [341024d5-aa0d-41f9-926a-3a74fd93c5f2] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 01:11:53.939194 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO oslo.messaging._drivers.impl_rabbit [None req-94d4920f-dbf6-47f0-90d3-acd5153e9a75 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [341024d5-aa0d-41f9-926a-3a74fd93c5f2] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 38120. Sep 14 01:11:53.961246 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-94d4920f-dbf6-47f0-90d3-acd5153e9a75 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-433840583" status: 202 len: 0 microversion: 2.1 time: 1.039403 Sep 14 01:11:53.962022 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 383/765] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Sep 14 01:11:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-433840583 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:11:54.626271 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a12dd7ca-7564-46cf-9032-6cc59c18a2b8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:54.626838 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a12dd7ca-7564-46cf-9032-6cc59c18a2b8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:54.637977 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a12dd7ca-7564-46cf-9032-6cc59c18a2b8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:54.638470 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a12dd7ca-7564-46cf-9032-6cc59c18a2b8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:54.638910 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a12dd7ca-7564-46cf-9032-6cc59c18a2b8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:54.639625 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a12dd7ca-7564-46cf-9032-6cc59c18a2b8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:54.640142 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a12dd7ca-7564-46cf-9032-6cc59c18a2b8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:54.640541 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a12dd7ca-7564-46cf-9032-6cc59c18a2b8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:54.721521 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-a12dd7ca-7564-46cf-9032-6cc59c18a2b8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lazy-loading 'services' on Instance uuid f390b4d1-983e-4ea4-bb3f-e7e7e82a564a {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:11:54.792064 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a12dd7ca-7564-46cf-9032-6cc59c18a2b8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a/os-volume_attachments/1ad2c6bf-fcdd-46fb-8adc-6122188ced6b" status: 202 len: 0 microversion: 2.1 time: 0.169685 Sep 14 01:11:54.792647 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 383/766] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 01:11:54 2022] DELETE /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a/os-volume_attachments/1ad2c6bf-fcdd-46fb-8adc-6122188ced6b => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:11:54.801859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a4afab8b-ee15-4ebe-ae89-64b8279802f2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:54.804069 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a4afab8b-ee15-4ebe-ae89-64b8279802f2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:54.809891 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a4afab8b-ee15-4ebe-ae89-64b8279802f2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:54.810366 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a4afab8b-ee15-4ebe-ae89-64b8279802f2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:54.810795 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a4afab8b-ee15-4ebe-ae89-64b8279802f2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:54.811479 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a4afab8b-ee15-4ebe-ae89-64b8279802f2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:54.811965 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a4afab8b-ee15-4ebe-ae89-64b8279802f2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:54.812384 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a4afab8b-ee15-4ebe-ae89-64b8279802f2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:54.845220 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a4afab8b-ee15-4ebe-ae89-64b8279802f2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047358 Sep 14 01:11:54.845780 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 384/767] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 01:11:54 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:11:55.859682 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-63b4dfb3-9532-4de6-b61d-bc263382d618 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:55.862044 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-63b4dfb3-9532-4de6-b61d-bc263382d618 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:55.868212 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-63b4dfb3-9532-4de6-b61d-bc263382d618 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:55.868697 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-63b4dfb3-9532-4de6-b61d-bc263382d618 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:55.869130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-63b4dfb3-9532-4de6-b61d-bc263382d618 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:55.869815 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-63b4dfb3-9532-4de6-b61d-bc263382d618 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:55.870267 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-63b4dfb3-9532-4de6-b61d-bc263382d618 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:55.870718 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-63b4dfb3-9532-4de6-b61d-bc263382d618 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:55.899755 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-63b4dfb3-9532-4de6-b61d-bc263382d618 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045379 Sep 14 01:11:55.900302 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 384/768] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 01:11:55 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 01:11:55.962854 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-66fbe55c-ee4d-4f8e-9df2-ee3ea9252e7a tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:55.963341 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-66fbe55c-ee4d-4f8e-9df2-ee3ea9252e7a tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:55.969975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-66fbe55c-ee4d-4f8e-9df2-ee3ea9252e7a tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:55.970453 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-66fbe55c-ee4d-4f8e-9df2-ee3ea9252e7a tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:55.970884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-66fbe55c-ee4d-4f8e-9df2-ee3ea9252e7a tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:55.971581 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-66fbe55c-ee4d-4f8e-9df2-ee3ea9252e7a tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:55.972049 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-66fbe55c-ee4d-4f8e-9df2-ee3ea9252e7a tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:55.972472 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-66fbe55c-ee4d-4f8e-9df2-ee3ea9252e7a tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:55.997203 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-66fbe55c-ee4d-4f8e-9df2-ee3ea9252e7a tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Going to try to terminate instance {{(pid=120621) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:11:56.074850 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-66fbe55c-ee4d-4f8e-9df2-ee3ea9252e7a tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 204 len: 0 microversion: 2.1 time: 0.115205 Sep 14 01:11:56.075389 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 385/769] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:11:55 2022] DELETE /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 01:11:56.084288 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ee414226-c082-431a-a45e-81c5f922044b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:56.084963 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ee414226-c082-431a-a45e-81c5f922044b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:56.091126 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ee414226-c082-431a-a45e-81c5f922044b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:56.091629 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ee414226-c082-431a-a45e-81c5f922044b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:56.092067 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ee414226-c082-431a-a45e-81c5f922044b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:56.092754 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ee414226-c082-431a-a45e-81c5f922044b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:56.093735 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ee414226-c082-431a-a45e-81c5f922044b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:56.094183 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ee414226-c082-431a-a45e-81c5f922044b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:56.228178 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ee414226-c082-431a-a45e-81c5f922044b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:56.236456 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ee414226-c082-431a-a45e-81c5f922044b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1683 microversion: 2.1 time: 0.156335 Sep 14 01:11:56.237028 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 385/770] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:56 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:57.260618 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fffd3877-75e7-43a7-a384-395c9bf9559c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:57.261312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fffd3877-75e7-43a7-a384-395c9bf9559c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:57.268033 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fffd3877-75e7-43a7-a384-395c9bf9559c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:57.268511 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fffd3877-75e7-43a7-a384-395c9bf9559c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:57.268947 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fffd3877-75e7-43a7-a384-395c9bf9559c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:57.269652 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fffd3877-75e7-43a7-a384-395c9bf9559c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:57.270134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fffd3877-75e7-43a7-a384-395c9bf9559c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:57.270560 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fffd3877-75e7-43a7-a384-395c9bf9559c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:57.488440 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fffd3877-75e7-43a7-a384-395c9bf9559c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:57.491917 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:11:57.496867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fffd3877-75e7-43a7-a384-395c9bf9559c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1683 microversion: 2.1 time: 0.240737 Sep 14 01:11:57.497433 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 386/771] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:57 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1683 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:58.168438 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-803a4443-b997-4d03-8a0f-3ec5bc5adb3c req-1a538b4b-9f3e-4c46-9eb4-7c000522450d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f390b4d1-983e-4ea4-bb3f-e7e7e82a564a", "name": "network-vif-deleted", "tag": "c55b96cb-5290-47cc-a378-c5a31536d115"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:11:58.182199 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-803a4443-b997-4d03-8a0f-3ec5bc5adb3c req-1a538b4b-9f3e-4c46-9eb4-7c000522450d service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:58.182684 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-803a4443-b997-4d03-8a0f-3ec5bc5adb3c req-1a538b4b-9f3e-4c46-9eb4-7c000522450d service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:58.183118 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-803a4443-b997-4d03-8a0f-3ec5bc5adb3c req-1a538b4b-9f3e-4c46-9eb4-7c000522450d service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:58.202476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-803a4443-b997-4d03-8a0f-3ec5bc5adb3c req-1a538b4b-9f3e-4c46-9eb4-7c000522450d service nova] Creating event network-vif-deleted:c55b96cb-5290-47cc-a378-c5a31536d115 for instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a on hv-cinder-85752 Sep 14 01:11:58.208991 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-803a4443-b997-4d03-8a0f-3ec5bc5adb3c req-1a538b4b-9f3e-4c46-9eb4-7c000522450d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044472 Sep 14 01:11:58.209592 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 386/772] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:11:58.522562 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0e190591-6220-4cfe-a03f-8237339f55a3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:58.523060 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0e190591-6220-4cfe-a03f-8237339f55a3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:58.531776 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e190591-6220-4cfe-a03f-8237339f55a3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:58.532651 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e190591-6220-4cfe-a03f-8237339f55a3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:58.533160 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e190591-6220-4cfe-a03f-8237339f55a3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:58.534051 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e190591-6220-4cfe-a03f-8237339f55a3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:58.534514 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e190591-6220-4cfe-a03f-8237339f55a3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:58.534957 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e190591-6220-4cfe-a03f-8237339f55a3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:58.566456 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e190591-6220-4cfe-a03f-8237339f55a3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:58.567238 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e190591-6220-4cfe-a03f-8237339f55a3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:58.567704 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0e190591-6220-4cfe-a03f-8237339f55a3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:58.568156 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-0e190591-6220-4cfe-a03f-8237339f55a3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lazy-loading 'fault' on Instance uuid f390b4d1-983e-4ea4-bb3f-e7e7e82a564a {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:11:58.608632 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0e190591-6220-4cfe-a03f-8237339f55a3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:11:58.616678 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0e190591-6220-4cfe-a03f-8237339f55a3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 200 len: 1332 microversion: 2.1 time: 0.098693 Sep 14 01:11:58.617321 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 387/773] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:58 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:11:59.641909 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e9ed36b7-56c5-4b68-908f-7bb43f88edc2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:59.642593 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-e9ed36b7-56c5-4b68-908f-7bb43f88edc2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:11:59.649330 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e9ed36b7-56c5-4b68-908f-7bb43f88edc2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:59.649803 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e9ed36b7-56c5-4b68-908f-7bb43f88edc2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:59.650236 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e9ed36b7-56c5-4b68-908f-7bb43f88edc2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:59.650945 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e9ed36b7-56c5-4b68-908f-7bb43f88edc2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:11:59.651398 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e9ed36b7-56c5-4b68-908f-7bb43f88edc2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:11:59.651861 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e9ed36b7-56c5-4b68-908f-7bb43f88edc2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:11:59.664623 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-e9ed36b7-56c5-4b68-908f-7bb43f88edc2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] HTTP exception thrown: Instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a could not be found. Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e9ed36b7-56c5-4b68-908f-7bb43f88edc2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Request method failure captured: Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a HTTP/1.1 Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISi3fXiNfssV-9suzyOi_X569sc3LzFc1vlFMuwkYOTf31lKxNzFY-VkibuUEPaC7Cvi81CQQfr4-r5n6Uvso8OzNo7bKIe7TyRgCLDNh1PVRJBuibEZ3mG6c00LHLtCWy0Oxl5Ip8Qv9iueHnKypM6PjqQ0qUH7793Mq_rFlqjqMYA Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:11:59.666252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:11:59.667866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:11:59.667866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:11:59.667866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:11:59.667866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:11:59.667866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:11:59.667866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:11:59.667866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:11:59.667866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: 51768890f19140b6819ef89f5bf610c8 Sep 14 01:11:59.667866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:11:59.667866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:11:59.667866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a could not be found. Sep 14 01:11:59.667866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': 'f390b4d1-983e-4ea4-bb3f-e7e7e82a564a'} Sep 14 01:11:59.668708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:11:59.668708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:11:59.668708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:11:59.668708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:11:59.668708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:11:59.668708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:11:59.668708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:11:59.668708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:11:59.668708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:11:59.668708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:11:59.668708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a could not be found. Sep 14 01:11:59.668708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:11:59.668708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:11:59.668708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:11:59.668708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:11:59.668708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:11:59.668708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:11:59.668708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:11:59.668708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:11:59.668708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:11:59.670115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:11:59.670115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:11:59.670115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:11:59.670115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:11:59.670115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:11:59.670115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:11:59.670115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:11:59.670115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a could not be found. Sep 14 01:11:59.670115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:11:59.670115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:11:59.670115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:11:59.670115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:11:59.670115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:11:59.670115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:11:59.670115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:11:59.670115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:11:59.670115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a could not be found. Sep 14 01:11:59.670115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:11:59.672595 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e9ed36b7-56c5-4b68-908f-7bb43f88edc2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Returning 404 to user: Instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:11:59.672595 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-e9ed36b7-56c5-4b68-908f-7bb43f88edc2 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 404 len: 111 microversion: 2.1 time: 0.029887 Sep 14 01:11:59.672595 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 387/774] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:11:59 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:11:59.677189 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f3ac47ec-883f-4629-913d-c42a3a4e86e1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '.version_select at 0x7f5043d3a3a0>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:11:59.696250 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f3ac47ec-883f-4629-913d-c42a3a4e86e1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898204071" status: 202 len: 0 microversion: 2.1 time: 0.022890 Sep 14 01:11:59.696803 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 388/775] 10.222.0.42 () {58 vars in 1221 bytes} [Wed Sep 14 01:11:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898204071 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:12:00.322673 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4f6844f5-48bd-440e-aa3e-95bb70a6d1ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Action: 'create', calling method: .version_select at 0x7f5043cedd30>, body: {"keypair": {"name": "tempest-keypair-988477203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvUyuYzCFYhNmfTIZbEKo3OkDYqaT9R/6sCHQP9Sdji8aoX+FXbvmLq6PgoRlPXkO2RD5BkF31VhDvOp9pJ4mMkWYOQ4jIy41pFD5JDpHGarREONSEsY/SzeGvnj8hIrw=="}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:12:00.337970 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-4f6844f5-48bd-440e-aa3e-95bb70a6d1ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Getting quotas for project 62cb41eb4b8244abb4aafd718b1207ad. Resources: {'key_pairs'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:12:00.342035 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-4f6844f5-48bd-440e-aa3e-95bb70a6d1ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Getting quotas for user 51768890f19140b6819ef89f5bf610c8 and project 62cb41eb4b8244abb4aafd718b1207ad. Resources: {'key_pairs'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:12:00.354344 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4f6844f5-48bd-440e-aa3e-95bb70a6d1ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [15ecb3ad-bc2c-48c4-a77a-4436d74b722c] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 01:12:01.361792 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO oslo.messaging._drivers.impl_rabbit [None req-4f6844f5-48bd-440e-aa3e-95bb70a6d1ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [15ecb3ad-bc2c-48c4-a77a-4436d74b722c] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 38168. Sep 14 01:12:01.375751 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4f6844f5-48bd-440e-aa3e-95bb70a6d1ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.057124 Sep 14 01:12:01.376280 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 388/776] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Sep 14 01:12:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:12:02.641796 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-837b7b1a-c688-4ae9-aabd-fdbafe788475 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-23574348", "imageRef": "a2619027-0d8b-4ca3-9528-1ac3380cab5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a458fb77-0452-4eef-a570-bd92e833719b"}], "security_groups": [{"name": "tempest-securitygroup--189993092"}], "key_name": "tempest-keypair-988477203", "user_data": "}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:12:02.761179 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-837b7b1a-c688-4ae9-aabd-fdbafe788475 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] validate_networks() for [('a458fb77-0452-4eef-a570-bd92e833719b', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:12:03.226957 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-837b7b1a-c688-4ae9-aabd-fdbafe788475 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:12:03.227378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-837b7b1a-c688-4ae9-aabd-fdbafe788475 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:12:03.227881 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-837b7b1a-c688-4ae9-aabd-fdbafe788475 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:12:03.228285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-837b7b1a-c688-4ae9-aabd-fdbafe788475 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:12:03.228696 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-837b7b1a-c688-4ae9-aabd-fdbafe788475 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:12:03.237976 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-837b7b1a-c688-4ae9-aabd-fdbafe788475 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:03.238452 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-837b7b1a-c688-4ae9-aabd-fdbafe788475 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:03.238917 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-837b7b1a-c688-4ae9-aabd-fdbafe788475 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:03.239671 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-837b7b1a-c688-4ae9-aabd-fdbafe788475 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:03.240122 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-837b7b1a-c688-4ae9-aabd-fdbafe788475 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:03.240546 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-837b7b1a-c688-4ae9-aabd-fdbafe788475 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:03.258046 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-837b7b1a-c688-4ae9-aabd-fdbafe788475 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Getting quotas for project 62cb41eb4b8244abb4aafd718b1207ad. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:12:03.262127 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-837b7b1a-c688-4ae9-aabd-fdbafe788475 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Getting quotas for user 51768890f19140b6819ef89f5bf610c8 and project 62cb41eb4b8244abb4aafd718b1207ad. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:12:03.273010 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-837b7b1a-c688-4ae9-aabd-fdbafe788475 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:12:03.275272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-837b7b1a-c688-4ae9-aabd-fdbafe788475 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a2619027-0d8b-4ca3-9528-1ac3380cab5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:12:03.320345 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR oslo.messaging._drivers.impl_rabbit [None req-837b7b1a-c688-4ae9-aabd-fdbafe788475 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [e4a8a8c6-2132-480d-b38e-7b0dc98fae43] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 01:12:04.328503 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO oslo.messaging._drivers.impl_rabbit [None req-837b7b1a-c688-4ae9-aabd-fdbafe788475 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [e4a8a8c6-2132-480d-b38e-7b0dc98fae43] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 38196. Sep 14 01:12:04.333103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-837b7b1a-c688-4ae9-aabd-fdbafe788475 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.697599 Sep 14 01:12:04.333776 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 389/777] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 01:12:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 1699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 01:12:04.347913 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-15077a0a-5e7d-4671-b4c2-0f32f5c46990 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:04.348817 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-15077a0a-5e7d-4671-b4c2-0f32f5c46990 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:04.406320 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-15077a0a-5e7d-4671-b4c2-0f32f5c46990 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:04.413276 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-15077a0a-5e7d-4671-b4c2-0f32f5c46990 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 200 len: 1239 microversion: 2.1 time: 0.069827 Sep 14 01:12:04.413839 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 389/778] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:04 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:04.494994 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-690b203e-dc5f-4a2b-8919-44f0af43db87 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:04.495484 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-690b203e-dc5f-4a2b-8919-44f0af43db87 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:04.502194 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-690b203e-dc5f-4a2b-8919-44f0af43db87 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:04.502675 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-690b203e-dc5f-4a2b-8919-44f0af43db87 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:04.503105 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-690b203e-dc5f-4a2b-8919-44f0af43db87 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:04.503836 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-690b203e-dc5f-4a2b-8919-44f0af43db87 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:04.504286 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-690b203e-dc5f-4a2b-8919-44f0af43db87 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:04.504706 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-690b203e-dc5f-4a2b-8919-44f0af43db87 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:04.536456 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-690b203e-dc5f-4a2b-8919-44f0af43db87 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9/os-volume_attachments/9b444da8-5741-41b4-9a05-dc713fe2fce0" status: 200 len: 194 microversion: 2.20 time: 0.045308 Sep 14 01:12:04.537447 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 390/779] 10.222.0.42 () {60 vars in 1454 bytes} [Wed Sep 14 01:12:04 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9/os-volume_attachments/9b444da8-5741-41b4-9a05-dc713fe2fce0 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 01:12:04.609589 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-210a2e9c-9cb5-4997-a42d-ed7a5c99ea82 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:04.610232 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-210a2e9c-9cb5-4997-a42d-ed7a5c99ea82 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:04.616424 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-210a2e9c-9cb5-4997-a42d-ed7a5c99ea82 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:04.617011 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-210a2e9c-9cb5-4997-a42d-ed7a5c99ea82 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:04.617679 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-210a2e9c-9cb5-4997-a42d-ed7a5c99ea82 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:04.618771 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-210a2e9c-9cb5-4997-a42d-ed7a5c99ea82 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:04.619411 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-210a2e9c-9cb5-4997-a42d-ed7a5c99ea82 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:04.619990 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-210a2e9c-9cb5-4997-a42d-ed7a5c99ea82 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:04.709977 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-210a2e9c-9cb5-4997-a42d-ed7a5c99ea82 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lazy-loading 'services' on Instance uuid d02da4a4-64f7-47c0-a48f-9cdb71f30df9 {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:12:04.785645 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-210a2e9c-9cb5-4997-a42d-ed7a5c99ea82 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9/os-volume_attachments/9b444da8-5741-41b4-9a05-dc713fe2fce0" status: 202 len: 0 microversion: 2.20 time: 0.180082 Sep 14 01:12:04.786229 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 390/780] 10.222.0.42 () {60 vars in 1457 bytes} [Wed Sep 14 01:12:04 2022] DELETE /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9/os-volume_attachments/9b444da8-5741-41b4-9a05-dc713fe2fce0 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 01:12:04.794771 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-99e7033b-2dc4-459b-a9ab-3dd9f74a7afe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:04.800728 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-99e7033b-2dc4-459b-a9ab-3dd9f74a7afe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:04.816010 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99e7033b-2dc4-459b-a9ab-3dd9f74a7afe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:04.816514 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99e7033b-2dc4-459b-a9ab-3dd9f74a7afe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:04.816951 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99e7033b-2dc4-459b-a9ab-3dd9f74a7afe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:04.817668 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99e7033b-2dc4-459b-a9ab-3dd9f74a7afe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:04.818116 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99e7033b-2dc4-459b-a9ab-3dd9f74a7afe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:04.818542 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99e7033b-2dc4-459b-a9ab-3dd9f74a7afe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:04.849953 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-99e7033b-2dc4-459b-a9ab-3dd9f74a7afe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059042 Sep 14 01:12:04.850432 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 391/781] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Sep 14 01:12:04 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 01:12:05.440355 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-b4178861-d8f8-4d19-a7f5-99e6eb06c907 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:05.442458 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-b4178861-d8f8-4d19-a7f5-99e6eb06c907 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:05.449971 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b4178861-d8f8-4d19-a7f5-99e6eb06c907 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:05.450484 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b4178861-d8f8-4d19-a7f5-99e6eb06c907 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:05.450923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b4178861-d8f8-4d19-a7f5-99e6eb06c907 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:05.452590 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b4178861-d8f8-4d19-a7f5-99e6eb06c907 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:05.453385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b4178861-d8f8-4d19-a7f5-99e6eb06c907 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:05.453995 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b4178861-d8f8-4d19-a7f5-99e6eb06c907 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:05.520297 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b4178861-d8f8-4d19-a7f5-99e6eb06c907 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:05.531066 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-b4178861-d8f8-4d19-a7f5-99e6eb06c907 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 200 len: 1291 microversion: 2.1 time: 0.097738 Sep 14 01:12:05.531788 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 391/782] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:05 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 1291 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:05.863573 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d868df7d-7c98-432c-b429-6bc440edf7f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:05.865674 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d868df7d-7c98-432c-b429-6bc440edf7f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:05.872017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d868df7d-7c98-432c-b429-6bc440edf7f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:05.872500 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d868df7d-7c98-432c-b429-6bc440edf7f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:05.872922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d868df7d-7c98-432c-b429-6bc440edf7f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:05.873592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d868df7d-7c98-432c-b429-6bc440edf7f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:05.874761 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d868df7d-7c98-432c-b429-6bc440edf7f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:05.875329 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d868df7d-7c98-432c-b429-6bc440edf7f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:05.910338 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d868df7d-7c98-432c-b429-6bc440edf7f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050776 Sep 14 01:12:05.911274 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 392/783] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Sep 14 01:12:05 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 01:12:06.554563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-3867422f-1199-4925-984b-cf728f3f3704 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:06.555181 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-3867422f-1199-4925-984b-cf728f3f3704 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:06.562117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3867422f-1199-4925-984b-cf728f3f3704 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:06.562611 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3867422f-1199-4925-984b-cf728f3f3704 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:06.563051 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3867422f-1199-4925-984b-cf728f3f3704 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:06.563786 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3867422f-1199-4925-984b-cf728f3f3704 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:06.564249 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3867422f-1199-4925-984b-cf728f3f3704 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:06.564677 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3867422f-1199-4925-984b-cf728f3f3704 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:06.627341 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-3867422f-1199-4925-984b-cf728f3f3704 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:06.635344 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-3867422f-1199-4925-984b-cf728f3f3704 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 200 len: 1297 microversion: 2.1 time: 0.084996 Sep 14 01:12:06.636084 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 392/784] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:06 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:06.924381 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8f56d793-22f0-4558-89b7-012fc09f5835 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:06.928535 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8f56d793-22f0-4558-89b7-012fc09f5835 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:06.939265 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8f56d793-22f0-4558-89b7-012fc09f5835 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:06.939799 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8f56d793-22f0-4558-89b7-012fc09f5835 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:06.940243 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8f56d793-22f0-4558-89b7-012fc09f5835 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:06.940931 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8f56d793-22f0-4558-89b7-012fc09f5835 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:06.941376 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8f56d793-22f0-4558-89b7-012fc09f5835 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:06.941796 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8f56d793-22f0-4558-89b7-012fc09f5835 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:06.974313 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8f56d793-22f0-4558-89b7-012fc09f5835 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055697 Sep 14 01:12:06.975137 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 393/785] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Sep 14 01:12:06 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:07.042448 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-3ff4b997-4ca8-4cbc-8af1-c256ec7142ef tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:07.042950 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-3ff4b997-4ca8-4cbc-8af1-c256ec7142ef tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:07.048890 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3ff4b997-4ca8-4cbc-8af1-c256ec7142ef tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:07.049501 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3ff4b997-4ca8-4cbc-8af1-c256ec7142ef tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:07.049939 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3ff4b997-4ca8-4cbc-8af1-c256ec7142ef tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:07.050636 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3ff4b997-4ca8-4cbc-8af1-c256ec7142ef tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:07.051096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3ff4b997-4ca8-4cbc-8af1-c256ec7142ef tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:07.051525 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3ff4b997-4ca8-4cbc-8af1-c256ec7142ef tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:07.076109 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-3ff4b997-4ca8-4cbc-8af1-c256ec7142ef tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Going to try to terminate instance {{(pid=120620) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:12:07.095741 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:07.165266 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-3ff4b997-4ca8-4cbc-8af1-c256ec7142ef tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 204 len: 0 microversion: 2.20 time: 0.126455 Sep 14 01:12:07.165968 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 393/786] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Sep 14 01:12:07 2022] DELETE /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 01:12:07.174833 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-aa84effb-8132-423f-95d5-9fd18944fd07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:07.175682 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-aa84effb-8132-423f-95d5-9fd18944fd07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:07.181631 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa84effb-8132-423f-95d5-9fd18944fd07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:07.182203 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa84effb-8132-423f-95d5-9fd18944fd07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:07.182701 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa84effb-8132-423f-95d5-9fd18944fd07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:07.183482 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa84effb-8132-423f-95d5-9fd18944fd07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:07.184026 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa84effb-8132-423f-95d5-9fd18944fd07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:07.184509 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa84effb-8132-423f-95d5-9fd18944fd07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:07.388370 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-aa84effb-8132-423f-95d5-9fd18944fd07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:07.397287 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-aa84effb-8132-423f-95d5-9fd18944fd07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:07.398630 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-aa84effb-8132-423f-95d5-9fd18944fd07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:07.399832 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-aa84effb-8132-423f-95d5-9fd18944fd07 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.229316 Sep 14 01:12:07.400394 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 394/787] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:12:07 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:12:07.659080 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-3922040b-d813-4b1a-a4a2-2127b001398d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:07.659819 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-3922040b-d813-4b1a-a4a2-2127b001398d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:07.662366 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:07.668831 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3922040b-d813-4b1a-a4a2-2127b001398d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:07.669329 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3922040b-d813-4b1a-a4a2-2127b001398d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:07.669771 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3922040b-d813-4b1a-a4a2-2127b001398d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:07.670472 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3922040b-d813-4b1a-a4a2-2127b001398d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:07.671477 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3922040b-d813-4b1a-a4a2-2127b001398d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:07.671944 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3922040b-d813-4b1a-a4a2-2127b001398d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:07.709277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-6604da9d-f482-40ed-a74f-d75920f59baa req-98ca910a-2b19-4c9c-9099-342423342d9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49f5ab2e-e424-49af-81ac-dc4b94c742b9", "tag": "07c78368-62fe-4df7-9562-b7b0093b41a9"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:12:07.730268 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-6604da9d-f482-40ed-a74f-d75920f59baa req-98ca910a-2b19-4c9c-9099-342423342d9f service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:07.730905 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-6604da9d-f482-40ed-a74f-d75920f59baa req-98ca910a-2b19-4c9c-9099-342423342d9f service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:07.731399 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-6604da9d-f482-40ed-a74f-d75920f59baa req-98ca910a-2b19-4c9c-9099-342423342d9f service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:07.743674 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-6604da9d-f482-40ed-a74f-d75920f59baa req-98ca910a-2b19-4c9c-9099-342423342d9f service nova] Creating event network-changed:07c78368-62fe-4df7-9562-b7b0093b41a9 for instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 on hv-cinder-85752 Sep 14 01:12:07.749462 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-6604da9d-f482-40ed-a74f-d75920f59baa req-98ca910a-2b19-4c9c-9099-342423342d9f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043631 Sep 14 01:12:07.750948 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 395/788] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:12:07.820738 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-3922040b-d813-4b1a-a4a2-2127b001398d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:07.828575 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-3922040b-d813-4b1a-a4a2-2127b001398d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 200 len: 1364 microversion: 2.1 time: 0.173995 Sep 14 01:12:07.829095 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 394/789] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:07 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:08.427515 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8515e277-b0aa-417c-a6b2-05af7de895df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:08.428162 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8515e277-b0aa-417c-a6b2-05af7de895df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:08.434815 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8515e277-b0aa-417c-a6b2-05af7de895df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:08.435313 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8515e277-b0aa-417c-a6b2-05af7de895df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:08.435769 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8515e277-b0aa-417c-a6b2-05af7de895df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:08.436463 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8515e277-b0aa-417c-a6b2-05af7de895df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:08.436923 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8515e277-b0aa-417c-a6b2-05af7de895df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:08.437353 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8515e277-b0aa-417c-a6b2-05af7de895df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:08.567208 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8515e277-b0aa-417c-a6b2-05af7de895df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:08.575417 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8515e277-b0aa-417c-a6b2-05af7de895df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:08.576873 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8515e277-b0aa-417c-a6b2-05af7de895df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:08.578016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8515e277-b0aa-417c-a6b2-05af7de895df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1724 microversion: 2.20 time: 0.154884 Sep 14 01:12:08.579264 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 396/790] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:12:08 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:12:08.850475 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-1acc4b83-a319-4b56-8a92-8ac91ea1d763 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:08.851096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-1acc4b83-a319-4b56-8a92-8ac91ea1d763 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:08.857973 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1acc4b83-a319-4b56-8a92-8ac91ea1d763 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:08.858474 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1acc4b83-a319-4b56-8a92-8ac91ea1d763 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:08.858897 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1acc4b83-a319-4b56-8a92-8ac91ea1d763 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:08.859623 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1acc4b83-a319-4b56-8a92-8ac91ea1d763 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:08.860086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1acc4b83-a319-4b56-8a92-8ac91ea1d763 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:08.860517 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1acc4b83-a319-4b56-8a92-8ac91ea1d763 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:08.988428 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-1acc4b83-a319-4b56-8a92-8ac91ea1d763 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:08.996053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-1acc4b83-a319-4b56-8a92-8ac91ea1d763 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 200 len: 1364 microversion: 2.1 time: 0.149539 Sep 14 01:12:08.996611 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 395/791] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:08 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:12:09.605368 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b11657a8-18ce-4131-a2ea-8c2e799e47b1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:09.606080 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b11657a8-18ce-4131-a2ea-8c2e799e47b1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:09.613320 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b11657a8-18ce-4131-a2ea-8c2e799e47b1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:09.613808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b11657a8-18ce-4131-a2ea-8c2e799e47b1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:09.614243 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b11657a8-18ce-4131-a2ea-8c2e799e47b1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:09.614938 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b11657a8-18ce-4131-a2ea-8c2e799e47b1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:09.615397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b11657a8-18ce-4131-a2ea-8c2e799e47b1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:09.615855 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b11657a8-18ce-4131-a2ea-8c2e799e47b1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:09.714610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b11657a8-18ce-4131-a2ea-8c2e799e47b1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:09.724268 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b11657a8-18ce-4131-a2ea-8c2e799e47b1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:09.727972 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b11657a8-18ce-4131-a2ea-8c2e799e47b1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:09.730361 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b11657a8-18ce-4131-a2ea-8c2e799e47b1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1657 microversion: 2.20 time: 0.128856 Sep 14 01:12:09.731354 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 397/792] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:12:09 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1657 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:12:09.981388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-598dbcdc-c083-46dc-8999-2b5f4ceb585e req-15277ff8-fe74-4039-91d5-c6c31883d9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02da4a4-64f7-47c0-a48f-9cdb71f30df9", "name": "network-vif-deleted", "tag": "61ac6a9d-d543-4896-a237-b3287bcd2644"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:12:09.992277 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-598dbcdc-c083-46dc-8999-2b5f4ceb585e req-15277ff8-fe74-4039-91d5-c6c31883d9ab service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:09.993003 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-598dbcdc-c083-46dc-8999-2b5f4ceb585e req-15277ff8-fe74-4039-91d5-c6c31883d9ab service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:09.993605 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-598dbcdc-c083-46dc-8999-2b5f4ceb585e req-15277ff8-fe74-4039-91d5-c6c31883d9ab service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:10.005388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-598dbcdc-c083-46dc-8999-2b5f4ceb585e req-15277ff8-fe74-4039-91d5-c6c31883d9ab service nova] Creating event network-vif-deleted:61ac6a9d-d543-4896-a237-b3287bcd2644 for instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 on hv-cinder-85752 Sep 14 01:12:10.011034 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-598dbcdc-c083-46dc-8999-2b5f4ceb585e req-15277ff8-fe74-4039-91d5-c6c31883d9ab service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033424 Sep 14 01:12:10.012255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 396/793] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:12:10.019895 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-52271c4b-5e95-4d4c-ae6c-b8f8373765e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:10.020543 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-52271c4b-5e95-4d4c-ae6c-b8f8373765e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:10.026795 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52271c4b-5e95-4d4c-ae6c-b8f8373765e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:10.027292 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52271c4b-5e95-4d4c-ae6c-b8f8373765e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:10.027758 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52271c4b-5e95-4d4c-ae6c-b8f8373765e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:10.028465 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52271c4b-5e95-4d4c-ae6c-b8f8373765e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:10.028921 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52271c4b-5e95-4d4c-ae6c-b8f8373765e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:10.029344 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52271c4b-5e95-4d4c-ae6c-b8f8373765e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:10.190068 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-52271c4b-5e95-4d4c-ae6c-b8f8373765e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:10.198726 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-52271c4b-5e95-4d4c-ae6c-b8f8373765e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 200 len: 1364 microversion: 2.1 time: 0.183511 Sep 14 01:12:10.199411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 398/794] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:10 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:12:10.757441 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-49c6b5d5-3f06-4f2c-b5db-aecd71a090f4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:10.758132 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-49c6b5d5-3f06-4f2c-b5db-aecd71a090f4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:10.764928 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-49c6b5d5-3f06-4f2c-b5db-aecd71a090f4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:10.765945 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-49c6b5d5-3f06-4f2c-b5db-aecd71a090f4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:10.766462 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-49c6b5d5-3f06-4f2c-b5db-aecd71a090f4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:10.767246 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-49c6b5d5-3f06-4f2c-b5db-aecd71a090f4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:10.767720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-49c6b5d5-3f06-4f2c-b5db-aecd71a090f4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:10.768143 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-49c6b5d5-3f06-4f2c-b5db-aecd71a090f4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:10.800880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-49c6b5d5-3f06-4f2c-b5db-aecd71a090f4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:10.801366 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-49c6b5d5-3f06-4f2c-b5db-aecd71a090f4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:10.801807 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-49c6b5d5-3f06-4f2c-b5db-aecd71a090f4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:10.802258 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-49c6b5d5-3f06-4f2c-b5db-aecd71a090f4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lazy-loading 'fault' on Instance uuid d02da4a4-64f7-47c0-a48f-9cdb71f30df9 {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:12:10.848448 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-49c6b5d5-3f06-4f2c-b5db-aecd71a090f4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:10.857744 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-49c6b5d5-3f06-4f2c-b5db-aecd71a090f4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:10.859398 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-49c6b5d5-3f06-4f2c-b5db-aecd71a090f4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:10.860684 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-49c6b5d5-3f06-4f2c-b5db-aecd71a090f4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1371 microversion: 2.20 time: 0.107512 Sep 14 01:12:10.861265 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 397/795] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:12:10 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:12:11.221075 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3a081284-d3b0-4d24-abae-32ed58478f09 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:11.221717 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3a081284-d3b0-4d24-abae-32ed58478f09 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:11.228413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3a081284-d3b0-4d24-abae-32ed58478f09 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:11.228963 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3a081284-d3b0-4d24-abae-32ed58478f09 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:11.229396 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3a081284-d3b0-4d24-abae-32ed58478f09 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:11.230129 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3a081284-d3b0-4d24-abae-32ed58478f09 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:11.230687 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3a081284-d3b0-4d24-abae-32ed58478f09 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:11.231240 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3a081284-d3b0-4d24-abae-32ed58478f09 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:11.366876 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3a081284-d3b0-4d24-abae-32ed58478f09 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:11.374398 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3a081284-d3b0-4d24-abae-32ed58478f09 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 200 len: 1364 microversion: 2.1 time: 0.157612 Sep 14 01:12:11.375645 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 399/796] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:11 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:11.886326 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-06c6757d-323c-43ef-9c83-f60883d3ffed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:11.887083 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-06c6757d-323c-43ef-9c83-f60883d3ffed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:11.893928 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-06c6757d-323c-43ef-9c83-f60883d3ffed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:11.894438 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-06c6757d-323c-43ef-9c83-f60883d3ffed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:11.894871 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-06c6757d-323c-43ef-9c83-f60883d3ffed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:11.895580 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-06c6757d-323c-43ef-9c83-f60883d3ffed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:11.896027 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-06c6757d-323c-43ef-9c83-f60883d3ffed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:11.896446 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-06c6757d-323c-43ef-9c83-f60883d3ffed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:11.927781 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-06c6757d-323c-43ef-9c83-f60883d3ffed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:11.928269 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-06c6757d-323c-43ef-9c83-f60883d3ffed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:11.928684 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-06c6757d-323c-43ef-9c83-f60883d3ffed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:11.929122 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-06c6757d-323c-43ef-9c83-f60883d3ffed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lazy-loading 'fault' on Instance uuid d02da4a4-64f7-47c0-a48f-9cdb71f30df9 {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:12:11.967878 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-06c6757d-323c-43ef-9c83-f60883d3ffed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:11.976373 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-06c6757d-323c-43ef-9c83-f60883d3ffed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:11.977811 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-06c6757d-323c-43ef-9c83-f60883d3ffed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:11.978955 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-06c6757d-323c-43ef-9c83-f60883d3ffed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1371 microversion: 2.20 time: 0.096907 Sep 14 01:12:11.979513 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 398/797] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:12:11 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:12:12.397852 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-013c16db-1039-4c0f-89d3-55760886c163 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:12.398490 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-013c16db-1039-4c0f-89d3-55760886c163 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:12.404869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-013c16db-1039-4c0f-89d3-55760886c163 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:12.405347 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-013c16db-1039-4c0f-89d3-55760886c163 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:12.405777 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-013c16db-1039-4c0f-89d3-55760886c163 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:12.407462 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-013c16db-1039-4c0f-89d3-55760886c163 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:12.407933 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-013c16db-1039-4c0f-89d3-55760886c163 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:12.408356 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-013c16db-1039-4c0f-89d3-55760886c163 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:12.538374 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-013c16db-1039-4c0f-89d3-55760886c163 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:12.546975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-013c16db-1039-4c0f-89d3-55760886c163 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 200 len: 1364 microversion: 2.1 time: 0.152825 Sep 14 01:12:12.547672 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 400/798] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:12 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:13.005188 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-aa3d35d6-1c83-4754-abf5-b45e158a30b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:13.005791 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-aa3d35d6-1c83-4754-abf5-b45e158a30b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:13.012085 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aa3d35d6-1c83-4754-abf5-b45e158a30b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:13.012567 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aa3d35d6-1c83-4754-abf5-b45e158a30b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:13.012998 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aa3d35d6-1c83-4754-abf5-b45e158a30b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:13.013683 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aa3d35d6-1c83-4754-abf5-b45e158a30b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:13.014136 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aa3d35d6-1c83-4754-abf5-b45e158a30b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:13.014773 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aa3d35d6-1c83-4754-abf5-b45e158a30b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:13.048875 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aa3d35d6-1c83-4754-abf5-b45e158a30b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:13.049357 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aa3d35d6-1c83-4754-abf5-b45e158a30b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:13.049792 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aa3d35d6-1c83-4754-abf5-b45e158a30b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:13.050244 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-aa3d35d6-1c83-4754-abf5-b45e158a30b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lazy-loading 'fault' on Instance uuid d02da4a4-64f7-47c0-a48f-9cdb71f30df9 {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:12:13.092548 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-aa3d35d6-1c83-4754-abf5-b45e158a30b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:13.100987 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-aa3d35d6-1c83-4754-abf5-b45e158a30b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:13.102910 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-aa3d35d6-1c83-4754-abf5-b45e158a30b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:13.104257 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-aa3d35d6-1c83-4754-abf5-b45e158a30b0 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 200 len: 1371 microversion: 2.20 time: 0.104384 Sep 14 01:12:13.104824 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 399/799] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:12:12 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:12:13.569589 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-031d3b02-7495-4d4b-b783-5250b5a8d449 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:13.570234 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-031d3b02-7495-4d4b-b783-5250b5a8d449 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:13.572201 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:13.572857 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=6 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:13.579208 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-031d3b02-7495-4d4b-b783-5250b5a8d449 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:13.579736 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-031d3b02-7495-4d4b-b783-5250b5a8d449 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:13.580177 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-031d3b02-7495-4d4b-b783-5250b5a8d449 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:13.580869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-031d3b02-7495-4d4b-b783-5250b5a8d449 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:13.581328 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-031d3b02-7495-4d4b-b783-5250b5a8d449 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:13.581758 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-031d3b02-7495-4d4b-b783-5250b5a8d449 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:13.717540 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-031d3b02-7495-4d4b-b783-5250b5a8d449 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:13.726508 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-031d3b02-7495-4d4b-b783-5250b5a8d449 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 200 len: 1364 microversion: 2.1 time: 0.160750 Sep 14 01:12:13.727212 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 401/800] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:13 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:14.129751 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-916ac223-4bcf-4eda-93b1-bcc21472bc85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:14.130416 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-916ac223-4bcf-4eda-93b1-bcc21472bc85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:14.136977 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-916ac223-4bcf-4eda-93b1-bcc21472bc85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:14.137452 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-916ac223-4bcf-4eda-93b1-bcc21472bc85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:14.137882 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-916ac223-4bcf-4eda-93b1-bcc21472bc85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:14.138562 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-916ac223-4bcf-4eda-93b1-bcc21472bc85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:14.139010 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-916ac223-4bcf-4eda-93b1-bcc21472bc85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:14.139425 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-916ac223-4bcf-4eda-93b1-bcc21472bc85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:14.152360 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-916ac223-4bcf-4eda-93b1-bcc21472bc85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] HTTP exception thrown: Instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 could not be found. Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-916ac223-4bcf-4eda-93b1-bcc21472bc85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Request method failure captured: Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 HTTP/1.1 Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISi5NAtlwNVAUPorDKGIaO0iprs9LJQxC18VQuZzT5kjD_wjtnPSS9LzNg5SKCygirCnnzM3YMEn0S6uqi5B99Ii301m1O_7OQMutHE2t7b3b8_0CEuxQ7iFqfFkecmdb3ctcTSBFWMV3J-UrkrRXv8LErPQT2lpjBU3nezVHKlE2lA Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 3c6482bb91c24939ba18c03a3e5bb18c Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1529918992 Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:12:14.153960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:12:14.155690 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:12:14.155690 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1529918992 Sep 14 01:12:14.155690 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 3c6482bb91c24939ba18c03a3e5bb18c Sep 14 01:12:14.155690 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1529918992 Sep 14 01:12:14.155690 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-AttachVolumeShelveTestJSON-1529918992-project Sep 14 01:12:14.155690 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:12:14.155690 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:12:14.155690 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: e4ad2d06f62246be8eb162257cbb4f8e Sep 14 01:12:14.155690 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1529918992-project Sep 14 01:12:14.155690 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:12:14.155690 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 could not be found. Sep 14 01:12:14.155690 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': 'd02da4a4-64f7-47c0-a48f-9cdb71f30df9'} Sep 14 01:12:14.157491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:12:14.157491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:12:14.157491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:12:14.157491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:12:14.157491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:12:14.157491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:12:14.157491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:12:14.157491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:12:14.157491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:12:14.157491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:12:14.157491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 could not be found. Sep 14 01:12:14.157491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:12:14.157491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:12:14.157491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:12:14.157491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:12:14.157491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:12:14.157491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:12:14.157491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:12:14.157491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:12:14.157491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:12:14.159103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:12:14.159103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:12:14.159103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:12:14.159103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:12:14.159103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:12:14.159103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:12:14.159103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:12:14.159103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 could not be found. Sep 14 01:12:14.159103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:12:14.159103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:12:14.159103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:12:14.159103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:12:14.159103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:12:14.159103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:12:14.159103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:12:14.159103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:12:14.159103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 could not be found. Sep 14 01:12:14.159103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:12:14.160647 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-916ac223-4bcf-4eda-93b1-bcc21472bc85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Returning 404 to user: Instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:12:14.160647 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-916ac223-4bcf-4eda-93b1-bcc21472bc85 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 404 len: 111 microversion: 2.20 time: 0.029428 Sep 14 01:12:14.160647 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 400/801] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:12:14 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 01:12:14.164939 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8f15a947-6e14-44fd-b919-6239a3725367 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '.version_select at 0x7f5043d3ae50>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:14.183841 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8f15a947-6e14-44fd-b919-6239a3725367 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-488413779" status: 204 len: 0 microversion: 2.20 time: 0.022714 Sep 14 01:12:14.184398 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 402/802] 10.222.0.42 () {60 vars in 1259 bytes} [Wed Sep 14 01:12:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-488413779 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 14 01:12:14.754376 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9d0586e5-944d-45a7-b017-015672613dcc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:14.754988 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9d0586e5-944d-45a7-b017-015672613dcc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:14.756998 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=6 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:14.767678 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9d0586e5-944d-45a7-b017-015672613dcc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:14.768174 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9d0586e5-944d-45a7-b017-015672613dcc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:14.768610 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9d0586e5-944d-45a7-b017-015672613dcc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:14.769314 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9d0586e5-944d-45a7-b017-015672613dcc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:14.769764 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9d0586e5-944d-45a7-b017-015672613dcc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:14.770202 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9d0586e5-944d-45a7-b017-015672613dcc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:14.836919 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8890f19e-bac1-47ac-8544-b1e07f0c422e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Action: 'create', calling method: .version_select at 0x7f5043c4f280>, body: {"keypair": {"name": "tempest-keypair-1750068040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDct0opJAZcOdACH31bfTLc3gjh1bYKj4O0guXzXZx3qMpI8N4SGAzvTJaCPaWaowEaGzcYr9Lx4rdmxsmXzuEPvdDu41jGKO2KeZSbXSPPuBr6D0rqEE9Eo2WCkZhB6g=="}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:12:14.853393 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-8890f19e-bac1-47ac-8544-b1e07f0c422e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Getting quotas for project 3c6482bb91c24939ba18c03a3e5bb18c. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:12:14.857538 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-8890f19e-bac1-47ac-8544-b1e07f0c422e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Getting quotas for user e4ad2d06f62246be8eb162257cbb4f8e and project 3c6482bb91c24939ba18c03a3e5bb18c. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:12:14.882302 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8890f19e-bac1-47ac-8544-b1e07f0c422e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049699 Sep 14 01:12:14.882906 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 403/803] 10.222.0.42 () {62 vars in 1200 bytes} [Wed Sep 14 01:12:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 14 01:12:14.922069 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9d0586e5-944d-45a7-b017-015672613dcc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:14.930433 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9d0586e5-944d-45a7-b017-015672613dcc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 200 len: 1364 microversion: 2.1 time: 0.180820 Sep 14 01:12:14.931060 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 401/804] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:14 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:15.955743 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e76cf7a0-d18a-4c2d-b875-479beb4a29c0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:15.956412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e76cf7a0-d18a-4c2d-b875-479beb4a29c0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:15.962315 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e76cf7a0-d18a-4c2d-b875-479beb4a29c0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:15.962794 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e76cf7a0-d18a-4c2d-b875-479beb4a29c0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:15.963223 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e76cf7a0-d18a-4c2d-b875-479beb4a29c0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:15.963939 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e76cf7a0-d18a-4c2d-b875-479beb4a29c0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:15.964385 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e76cf7a0-d18a-4c2d-b875-479beb4a29c0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:15.964808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e76cf7a0-d18a-4c2d-b875-479beb4a29c0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:16.131429 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e76cf7a0-d18a-4c2d-b875-479beb4a29c0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:16.140168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e76cf7a0-d18a-4c2d-b875-479beb4a29c0 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 200 len: 1364 microversion: 2.1 time: 0.189578 Sep 14 01:12:16.140869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 404/805] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:15 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:16.197307 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-3193ac79-1f2b-4558-b598-550ceebbdb3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1537277338", "imageRef": "a2619027-0d8b-4ca3-9528-1ac3380cab5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c98240d0-3126-41fb-afde-91eebe272174"}], "security_groups": [{"name": "tempest-securitygroup--1550299666"}], "key_name": "tempest-keypair-1750068040", "user_data": "}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:12:16.301185 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.network.neutron [None req-3193ac79-1f2b-4558-b598-550ceebbdb3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] validate_networks() for [('c98240d0-3126-41fb-afde-91eebe272174', None, None, None, None, None)] {{(pid=120620) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:12:16.677487 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-3193ac79-1f2b-4558-b598-550ceebbdb3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Flavor limits 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:12:16.677902 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-3193ac79-1f2b-4558-b598-550ceebbdb3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Image limits 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:12:16.678369 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-3193ac79-1f2b-4558-b598-550ceebbdb3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Flavor pref 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:12:16.678773 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-3193ac79-1f2b-4558-b598-550ceebbdb3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Image pref 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:12:16.679343 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-3193ac79-1f2b-4558-b598-550ceebbdb3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:12:16.689186 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3193ac79-1f2b-4558-b598-550ceebbdb3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:16.689670 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3193ac79-1f2b-4558-b598-550ceebbdb3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:16.690102 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3193ac79-1f2b-4558-b598-550ceebbdb3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:16.690819 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3193ac79-1f2b-4558-b598-550ceebbdb3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:16.691270 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3193ac79-1f2b-4558-b598-550ceebbdb3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:16.691714 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3193ac79-1f2b-4558-b598-550ceebbdb3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:16.709046 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-3193ac79-1f2b-4558-b598-550ceebbdb3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Getting quotas for project 3c6482bb91c24939ba18c03a3e5bb18c. Resources: {'cores', 'instances', 'ram'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:12:16.713049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-3193ac79-1f2b-4558-b598-550ceebbdb3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Getting quotas for user e4ad2d06f62246be8eb162257cbb4f8e and project 3c6482bb91c24939ba18c03a3e5bb18c. Resources: {'cores', 'instances', 'ram'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:12:16.713230 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-e9cb33a4-2815-4f7a-9240-e8a2f4099eb4 req-9b9f891a-dcaa-433b-ac5c-3590b0e311ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f5ab2e-e424-49af-81ac-dc4b94c742b9", "name": "network-vif-plugged", "status": "completed", "tag": "07c78368-62fe-4df7-9562-b7b0093b41a9"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:12:16.724128 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-e9cb33a4-2815-4f7a-9240-e8a2f4099eb4 req-9b9f891a-dcaa-433b-ac5c-3590b0e311ee service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:16.724665 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-e9cb33a4-2815-4f7a-9240-e8a2f4099eb4 req-9b9f891a-dcaa-433b-ac5c-3590b0e311ee service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:16.725102 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-e9cb33a4-2815-4f7a-9240-e8a2f4099eb4 req-9b9f891a-dcaa-433b-ac5c-3590b0e311ee service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:16.726446 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-3193ac79-1f2b-4558-b598-550ceebbdb3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Going to run 1 instances... {{(pid=120620) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:12:16.728880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-3193ac79-1f2b-4558-b598-550ceebbdb3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a2619027-0d8b-4ca3-9528-1ac3380cab5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120620) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:12:16.738541 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-e9cb33a4-2815-4f7a-9240-e8a2f4099eb4 req-9b9f891a-dcaa-433b-ac5c-3590b0e311ee service nova] Creating event network-vif-plugged:07c78368-62fe-4df7-9562-b7b0093b41a9 for instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 on hv-cinder-85752 Sep 14 01:12:16.744509 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-e9cb33a4-2815-4f7a-9240-e8a2f4099eb4 req-9b9f891a-dcaa-433b-ac5c-3590b0e311ee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035738 Sep 14 01:12:16.745205 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 405/806] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:12:16.782354 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-3193ac79-1f2b-4558-b598-550ceebbdb3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.589269 Sep 14 01:12:16.783466 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 402/807] 10.222.0.42 () {62 vars in 1188 bytes} [Wed Sep 14 01:12:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 01:12:16.794710 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-420bd7ab-cd5c-4e48-82d5-8856f1e74f0c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:16.795992 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-420bd7ab-cd5c-4e48-82d5-8856f1e74f0c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:16.855824 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-420bd7ab-cd5c-4e48-82d5-8856f1e74f0c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:16.864444 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-420bd7ab-cd5c-4e48-82d5-8856f1e74f0c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:16.865876 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-420bd7ab-cd5c-4e48-82d5-8856f1e74f0c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:16.866972 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-420bd7ab-cd5c-4e48-82d5-8856f1e74f0c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1282 microversion: 2.20 time: 0.076725 Sep 14 01:12:16.868035 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 406/808] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:12:16 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1282 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:12:17.164274 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0c18702f-b65b-4fd2-98ef-50fa29e498ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:17.165510 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0c18702f-b65b-4fd2-98ef-50fa29e498ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:17.172950 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0c18702f-b65b-4fd2-98ef-50fa29e498ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:17.173435 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0c18702f-b65b-4fd2-98ef-50fa29e498ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:17.173873 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0c18702f-b65b-4fd2-98ef-50fa29e498ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:17.174625 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0c18702f-b65b-4fd2-98ef-50fa29e498ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:17.175020 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0c18702f-b65b-4fd2-98ef-50fa29e498ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:17.175446 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0c18702f-b65b-4fd2-98ef-50fa29e498ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:17.304246 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0c18702f-b65b-4fd2-98ef-50fa29e498ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:17.311785 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0c18702f-b65b-4fd2-98ef-50fa29e498ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 200 len: 1364 microversion: 2.1 time: 0.152200 Sep 14 01:12:17.312590 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 403/809] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:17 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:17.893671 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-63896f1e-6277-4432-844a-ff40bbbf164d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:17.894213 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-63896f1e-6277-4432-844a-ff40bbbf164d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:17.900860 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-63896f1e-6277-4432-844a-ff40bbbf164d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:17.901340 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-63896f1e-6277-4432-844a-ff40bbbf164d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:17.901774 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-63896f1e-6277-4432-844a-ff40bbbf164d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:17.902459 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-63896f1e-6277-4432-844a-ff40bbbf164d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:17.902912 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-63896f1e-6277-4432-844a-ff40bbbf164d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:17.903333 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-63896f1e-6277-4432-844a-ff40bbbf164d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:17.963958 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-63896f1e-6277-4432-844a-ff40bbbf164d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:17.972008 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-63896f1e-6277-4432-844a-ff40bbbf164d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:17.973449 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-63896f1e-6277-4432-844a-ff40bbbf164d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:17.974534 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-63896f1e-6277-4432-844a-ff40bbbf164d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1278 microversion: 2.20 time: 0.085640 Sep 14 01:12:17.975085 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 407/810] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:12:17 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:12:18.334754 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-52ec5c5b-3cc1-42cd-ba47-3e8871aa9c02 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:18.335373 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-52ec5c5b-3cc1-42cd-ba47-3e8871aa9c02 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:18.341830 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-52ec5c5b-3cc1-42cd-ba47-3e8871aa9c02 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:18.342310 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-52ec5c5b-3cc1-42cd-ba47-3e8871aa9c02 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:18.342888 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-52ec5c5b-3cc1-42cd-ba47-3e8871aa9c02 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:18.343598 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-52ec5c5b-3cc1-42cd-ba47-3e8871aa9c02 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:18.344072 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-52ec5c5b-3cc1-42cd-ba47-3e8871aa9c02 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:18.344831 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-52ec5c5b-3cc1-42cd-ba47-3e8871aa9c02 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:18.485273 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-52ec5c5b-3cc1-42cd-ba47-3e8871aa9c02 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:18.493011 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-52ec5c5b-3cc1-42cd-ba47-3e8871aa9c02 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 200 len: 1364 microversion: 2.1 time: 0.162099 Sep 14 01:12:18.493565 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 404/811] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:18 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:18.998901 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-936d906a-618b-4247-9049-5185d9094e37 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:18.999492 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-936d906a-618b-4247-9049-5185d9094e37 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:19.001935 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:19.007138 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-936d906a-618b-4247-9049-5185d9094e37 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:19.007648 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-936d906a-618b-4247-9049-5185d9094e37 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:19.008086 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-936d906a-618b-4247-9049-5185d9094e37 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:19.009030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-936d906a-618b-4247-9049-5185d9094e37 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:19.009482 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-936d906a-618b-4247-9049-5185d9094e37 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:19.009904 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-936d906a-618b-4247-9049-5185d9094e37 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:19.072304 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-936d906a-618b-4247-9049-5185d9094e37 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:19.080762 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-936d906a-618b-4247-9049-5185d9094e37 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:19.082192 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-936d906a-618b-4247-9049-5185d9094e37 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:19.083283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-936d906a-618b-4247-9049-5185d9094e37 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1334 microversion: 2.20 time: 0.088267 Sep 14 01:12:19.083877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 408/812] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:12:18 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1334 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:12:19.515640 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-1295e0d0-7379-42bf-9289-23f2d60cada9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:19.516955 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-1295e0d0-7379-42bf-9289-23f2d60cada9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:19.523665 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1295e0d0-7379-42bf-9289-23f2d60cada9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:19.524154 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1295e0d0-7379-42bf-9289-23f2d60cada9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:19.524748 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1295e0d0-7379-42bf-9289-23f2d60cada9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:19.525449 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1295e0d0-7379-42bf-9289-23f2d60cada9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:19.525905 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1295e0d0-7379-42bf-9289-23f2d60cada9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:19.526333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1295e0d0-7379-42bf-9289-23f2d60cada9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:19.656977 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-1295e0d0-7379-42bf-9289-23f2d60cada9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:19.664682 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-1295e0d0-7379-42bf-9289-23f2d60cada9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 200 len: 1554 microversion: 2.1 time: 0.152981 Sep 14 01:12:19.665247 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 405/813] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:19 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:19.687294 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-809c4ee5-8ec1-46ad-a97d-7d1cb6d1d825 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:19.688389 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-809c4ee5-8ec1-46ad-a97d-7d1cb6d1d825 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:19.694424 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-809c4ee5-8ec1-46ad-a97d-7d1cb6d1d825 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:19.694911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-809c4ee5-8ec1-46ad-a97d-7d1cb6d1d825 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:19.695352 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-809c4ee5-8ec1-46ad-a97d-7d1cb6d1d825 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:19.696078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-809c4ee5-8ec1-46ad-a97d-7d1cb6d1d825 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:19.696534 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-809c4ee5-8ec1-46ad-a97d-7d1cb6d1d825 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:19.696962 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-809c4ee5-8ec1-46ad-a97d-7d1cb6d1d825 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:19.700577 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:19.813436 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-809c4ee5-8ec1-46ad-a97d-7d1cb6d1d825 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129607 Sep 14 01:12:19.814053 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 409/814] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Sep 14 01:12:19 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:12:20.108621 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-b48c2e08-6eb6-4b85-8f1c-adb58bcbd7bd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:20.109222 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-b48c2e08-6eb6-4b85-8f1c-adb58bcbd7bd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:20.115537 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b48c2e08-6eb6-4b85-8f1c-adb58bcbd7bd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:20.116069 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b48c2e08-6eb6-4b85-8f1c-adb58bcbd7bd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:20.116510 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b48c2e08-6eb6-4b85-8f1c-adb58bcbd7bd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:20.117214 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b48c2e08-6eb6-4b85-8f1c-adb58bcbd7bd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:20.117671 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b48c2e08-6eb6-4b85-8f1c-adb58bcbd7bd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:20.118098 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b48c2e08-6eb6-4b85-8f1c-adb58bcbd7bd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:20.191845 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b48c2e08-6eb6-4b85-8f1c-adb58bcbd7bd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:20.200027 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b48c2e08-6eb6-4b85-8f1c-adb58bcbd7bd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:20.201694 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b48c2e08-6eb6-4b85-8f1c-adb58bcbd7bd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:20.202814 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-b48c2e08-6eb6-4b85-8f1c-adb58bcbd7bd tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1340 microversion: 2.20 time: 0.098328 Sep 14 01:12:20.203402 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 406/815] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:12:20 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1340 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:12:21.005441 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-0c999362-3ed8-4575-9c85-4343bae52810 req-1204533b-601a-490b-a157-465ae20b6e50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "291f27aa-9e42-4937-be7d-5e849d90e611", "tag": "5a0c8ef2-8392-47a2-bf1c-1530912083d1"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:12:21.024735 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-0c999362-3ed8-4575-9c85-4343bae52810 req-1204533b-601a-490b-a157-465ae20b6e50 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:21.034927 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-3d5dbd05-2bd4-47db-a1dc-4103f438d144 req-8c64992d-90fc-4b04-aed2-f2cba3944296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49f5ab2e-e424-49af-81ac-dc4b94c742b9", "tag": "07c78368-62fe-4df7-9562-b7b0093b41a9"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:12:21.041473 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-0c999362-3ed8-4575-9c85-4343bae52810 req-1204533b-601a-490b-a157-465ae20b6e50 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:21.043149 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-0c999362-3ed8-4575-9c85-4343bae52810 req-1204533b-601a-490b-a157-465ae20b6e50 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:21.057427 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-3d5dbd05-2bd4-47db-a1dc-4103f438d144 req-8c64992d-90fc-4b04-aed2-f2cba3944296 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:21.060117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-3d5dbd05-2bd4-47db-a1dc-4103f438d144 req-8c64992d-90fc-4b04-aed2-f2cba3944296 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:21.061725 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-3d5dbd05-2bd4-47db-a1dc-4103f438d144 req-8c64992d-90fc-4b04-aed2-f2cba3944296 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:21.069545 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-0c999362-3ed8-4575-9c85-4343bae52810 req-1204533b-601a-490b-a157-465ae20b6e50 service nova] Creating event network-changed:5a0c8ef2-8392-47a2-bf1c-1530912083d1 for instance 291f27aa-9e42-4937-be7d-5e849d90e611 on hv-cinder-85752 Sep 14 01:12:21.092002 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-0c999362-3ed8-4575-9c85-4343bae52810 req-1204533b-601a-490b-a157-465ae20b6e50 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092812 Sep 14 01:12:21.093221 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 410/816] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:12:21.095286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-3d5dbd05-2bd4-47db-a1dc-4103f438d144 req-8c64992d-90fc-4b04-aed2-f2cba3944296 service nova] Creating event network-changed:07c78368-62fe-4df7-9562-b7b0093b41a9 for instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 on hv-cinder-85752 Sep 14 01:12:21.101675 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-3d5dbd05-2bd4-47db-a1dc-4103f438d144 req-8c64992d-90fc-4b04-aed2-f2cba3944296 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074370 Sep 14 01:12:21.102565 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 407/817] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:12:21.230932 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-89570c5a-30a0-485d-ae3e-1de503127d53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:21.231903 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-89570c5a-30a0-485d-ae3e-1de503127d53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:21.239831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-89570c5a-30a0-485d-ae3e-1de503127d53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:21.240616 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-89570c5a-30a0-485d-ae3e-1de503127d53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:21.242075 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-89570c5a-30a0-485d-ae3e-1de503127d53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:21.242971 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-89570c5a-30a0-485d-ae3e-1de503127d53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:21.243621 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-89570c5a-30a0-485d-ae3e-1de503127d53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:21.244345 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-89570c5a-30a0-485d-ae3e-1de503127d53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:21.494650 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-89570c5a-30a0-485d-ae3e-1de503127d53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:21.503700 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-89570c5a-30a0-485d-ae3e-1de503127d53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:21.505152 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-89570c5a-30a0-485d-ae3e-1de503127d53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:21.506275 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-89570c5a-30a0-485d-ae3e-1de503127d53 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1408 microversion: 2.20 time: 0.280492 Sep 14 01:12:21.507021 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 411/818] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:12:21 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1408 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:12:22.533737 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7a8ff7b8-736e-4919-86e3-a3818741a3c2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:22.534416 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7a8ff7b8-736e-4919-86e3-a3818741a3c2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:22.540658 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7a8ff7b8-736e-4919-86e3-a3818741a3c2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:22.541141 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7a8ff7b8-736e-4919-86e3-a3818741a3c2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:22.541579 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7a8ff7b8-736e-4919-86e3-a3818741a3c2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:22.542268 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7a8ff7b8-736e-4919-86e3-a3818741a3c2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:22.542753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7a8ff7b8-736e-4919-86e3-a3818741a3c2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:22.543180 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7a8ff7b8-736e-4919-86e3-a3818741a3c2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:22.671853 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7a8ff7b8-736e-4919-86e3-a3818741a3c2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:22.679911 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7a8ff7b8-736e-4919-86e3-a3818741a3c2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:22.681357 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7a8ff7b8-736e-4919-86e3-a3818741a3c2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:22.682465 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7a8ff7b8-736e-4919-86e3-a3818741a3c2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1408 microversion: 2.20 time: 0.154275 Sep 14 01:12:22.683020 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 408/819] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:12:22 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:12:23.707734 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-646a9aaa-588f-433f-b216-ea5fbfe8ffeb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:23.708334 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-646a9aaa-588f-433f-b216-ea5fbfe8ffeb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:23.714757 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-646a9aaa-588f-433f-b216-ea5fbfe8ffeb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:23.715233 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-646a9aaa-588f-433f-b216-ea5fbfe8ffeb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:23.715690 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-646a9aaa-588f-433f-b216-ea5fbfe8ffeb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:23.716368 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-646a9aaa-588f-433f-b216-ea5fbfe8ffeb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:23.716815 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-646a9aaa-588f-433f-b216-ea5fbfe8ffeb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:23.717233 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-646a9aaa-588f-433f-b216-ea5fbfe8ffeb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:23.847335 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-646a9aaa-588f-433f-b216-ea5fbfe8ffeb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:23.855512 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-646a9aaa-588f-433f-b216-ea5fbfe8ffeb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:23.857014 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-646a9aaa-588f-433f-b216-ea5fbfe8ffeb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:23.858122 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-646a9aaa-588f-433f-b216-ea5fbfe8ffeb tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1408 microversion: 2.20 time: 0.155018 Sep 14 01:12:23.858710 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 412/820] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:12:23 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:12:24.883807 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-66799e49-8f88-422d-90a2-f5ac31e423f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:24.884362 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-66799e49-8f88-422d-90a2-f5ac31e423f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:24.890823 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-66799e49-8f88-422d-90a2-f5ac31e423f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:24.891297 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-66799e49-8f88-422d-90a2-f5ac31e423f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:24.891763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-66799e49-8f88-422d-90a2-f5ac31e423f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:24.892459 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-66799e49-8f88-422d-90a2-f5ac31e423f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:24.892923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-66799e49-8f88-422d-90a2-f5ac31e423f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:24.893350 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-66799e49-8f88-422d-90a2-f5ac31e423f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:25.026075 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-66799e49-8f88-422d-90a2-f5ac31e423f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:25.034234 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-66799e49-8f88-422d-90a2-f5ac31e423f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:25.035715 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-66799e49-8f88-422d-90a2-f5ac31e423f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:25.036819 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-66799e49-8f88-422d-90a2-f5ac31e423f9 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1408 microversion: 2.20 time: 0.157361 Sep 14 01:12:25.037375 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 409/821] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:12:24 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:12:26.063450 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8b341641-a894-4e2b-b945-9cb191c5202a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:26.064120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8b341641-a894-4e2b-b945-9cb191c5202a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:26.070526 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8b341641-a894-4e2b-b945-9cb191c5202a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:26.071015 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8b341641-a894-4e2b-b945-9cb191c5202a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:26.071463 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8b341641-a894-4e2b-b945-9cb191c5202a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:26.072166 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8b341641-a894-4e2b-b945-9cb191c5202a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:26.072618 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8b341641-a894-4e2b-b945-9cb191c5202a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:26.073045 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8b341641-a894-4e2b-b945-9cb191c5202a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:26.201543 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8b341641-a894-4e2b-b945-9cb191c5202a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:26.209790 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8b341641-a894-4e2b-b945-9cb191c5202a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:26.211235 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8b341641-a894-4e2b-b945-9cb191c5202a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:26.212372 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8b341641-a894-4e2b-b945-9cb191c5202a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1408 microversion: 2.20 time: 0.153037 Sep 14 01:12:26.212936 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 413/822] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:12:26 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:12:26.608658 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-b989074a-31e7-4ce1-9368-7abf41b8f43b req-eca2a32a-1039-4340-8bb9-b54e52b3eb64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291f27aa-9e42-4937-be7d-5e849d90e611", "name": "network-vif-plugged", "status": "completed", "tag": "5a0c8ef2-8392-47a2-bf1c-1530912083d1"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:12:26.618803 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-b989074a-31e7-4ce1-9368-7abf41b8f43b req-eca2a32a-1039-4340-8bb9-b54e52b3eb64 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:26.619283 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-b989074a-31e7-4ce1-9368-7abf41b8f43b req-eca2a32a-1039-4340-8bb9-b54e52b3eb64 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:26.619743 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-b989074a-31e7-4ce1-9368-7abf41b8f43b req-eca2a32a-1039-4340-8bb9-b54e52b3eb64 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:26.631074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-b989074a-31e7-4ce1-9368-7abf41b8f43b req-eca2a32a-1039-4340-8bb9-b54e52b3eb64 service nova] Creating event network-vif-plugged:5a0c8ef2-8392-47a2-bf1c-1530912083d1 for instance 291f27aa-9e42-4937-be7d-5e849d90e611 on hv-cinder-85752 Sep 14 01:12:26.636293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-b989074a-31e7-4ce1-9368-7abf41b8f43b req-eca2a32a-1039-4340-8bb9-b54e52b3eb64 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031351 Sep 14 01:12:26.637165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 410/823] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:12:27.238588 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-79b08f31-ac13-4e89-8df5-fee2e94d2180 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:27.239183 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-79b08f31-ac13-4e89-8df5-fee2e94d2180 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:27.241138 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=6 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:27.246763 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-79b08f31-ac13-4e89-8df5-fee2e94d2180 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:27.247239 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-79b08f31-ac13-4e89-8df5-fee2e94d2180 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:27.247702 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-79b08f31-ac13-4e89-8df5-fee2e94d2180 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:27.248386 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-79b08f31-ac13-4e89-8df5-fee2e94d2180 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:27.248837 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-79b08f31-ac13-4e89-8df5-fee2e94d2180 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:27.249258 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-79b08f31-ac13-4e89-8df5-fee2e94d2180 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:27.382071 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-79b08f31-ac13-4e89-8df5-fee2e94d2180 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:27.390238 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-79b08f31-ac13-4e89-8df5-fee2e94d2180 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:27.392076 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-79b08f31-ac13-4e89-8df5-fee2e94d2180 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:27.393168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-79b08f31-ac13-4e89-8df5-fee2e94d2180 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1408 microversion: 2.20 time: 0.159178 Sep 14 01:12:27.393723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 414/824] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:12:27 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:12:28.415030 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=2 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:28.415823 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=6 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:28.421353 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9115d38b-90c8-4642-9480-09786b0b4cd6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:28.422100 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9115d38b-90c8-4642-9480-09786b0b4cd6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:28.429119 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9115d38b-90c8-4642-9480-09786b0b4cd6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:28.429605 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9115d38b-90c8-4642-9480-09786b0b4cd6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:28.430043 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9115d38b-90c8-4642-9480-09786b0b4cd6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:28.430764 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9115d38b-90c8-4642-9480-09786b0b4cd6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:28.431218 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9115d38b-90c8-4642-9480-09786b0b4cd6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:28.431666 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9115d38b-90c8-4642-9480-09786b0b4cd6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:28.449103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:28.575634 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9115d38b-90c8-4642-9480-09786b0b4cd6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:28.584477 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9115d38b-90c8-4642-9480-09786b0b4cd6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:28.585929 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9115d38b-90c8-4642-9480-09786b0b4cd6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:28.587035 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9115d38b-90c8-4642-9480-09786b0b4cd6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1408 microversion: 2.20 time: 0.173020 Sep 14 01:12:28.587609 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 411/825] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:12:28 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:12:29.610726 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-807fac5e-b4e1-4c8f-9715-2411775aef54 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:29.611319 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-807fac5e-b4e1-4c8f-9715-2411775aef54 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:29.617882 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-807fac5e-b4e1-4c8f-9715-2411775aef54 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:29.618361 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-807fac5e-b4e1-4c8f-9715-2411775aef54 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:29.618810 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-807fac5e-b4e1-4c8f-9715-2411775aef54 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:29.619489 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-807fac5e-b4e1-4c8f-9715-2411775aef54 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:29.619970 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-807fac5e-b4e1-4c8f-9715-2411775aef54 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:29.620388 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-807fac5e-b4e1-4c8f-9715-2411775aef54 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:29.751007 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-807fac5e-b4e1-4c8f-9715-2411775aef54 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:29.759188 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-807fac5e-b4e1-4c8f-9715-2411775aef54 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:29.760715 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-807fac5e-b4e1-4c8f-9715-2411775aef54 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:29.761850 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-807fac5e-b4e1-4c8f-9715-2411775aef54 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1600 microversion: 2.20 time: 0.155013 Sep 14 01:12:29.762398 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 415/826] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:12:29 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:12:29.786563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6a9e4dad-1195-4113-ad76-12396ce203b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:29.787052 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-6a9e4dad-1195-4113-ad76-12396ce203b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:29.793372 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6a9e4dad-1195-4113-ad76-12396ce203b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:29.793857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6a9e4dad-1195-4113-ad76-12396ce203b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:29.794291 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6a9e4dad-1195-4113-ad76-12396ce203b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:29.794987 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6a9e4dad-1195-4113-ad76-12396ce203b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:29.795441 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6a9e4dad-1195-4113-ad76-12396ce203b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:29.795900 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6a9e4dad-1195-4113-ad76-12396ce203b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:29.871134 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-6a9e4dad-1195-4113-ad76-12396ce203b8 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088470 Sep 14 01:12:29.871753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 412/827] 10.222.0.42 () {60 vars in 1316 bytes} [Wed Sep 14 01:12:29 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 01:12:30.777278 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-9127a19f-c749-42e7-80bc-c1acd279493c req-4da684b9-68d0-43b3-8c50-540a46562bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "291f27aa-9e42-4937-be7d-5e849d90e611", "tag": "5a0c8ef2-8392-47a2-bf1c-1530912083d1"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:12:30.788205 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-9127a19f-c749-42e7-80bc-c1acd279493c req-4da684b9-68d0-43b3-8c50-540a46562bf1 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:30.788680 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-9127a19f-c749-42e7-80bc-c1acd279493c req-4da684b9-68d0-43b3-8c50-540a46562bf1 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:30.789107 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-9127a19f-c749-42e7-80bc-c1acd279493c req-4da684b9-68d0-43b3-8c50-540a46562bf1 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:30.800426 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-9127a19f-c749-42e7-80bc-c1acd279493c req-4da684b9-68d0-43b3-8c50-540a46562bf1 service nova] Creating event network-changed:5a0c8ef2-8392-47a2-bf1c-1530912083d1 for instance 291f27aa-9e42-4937-be7d-5e849d90e611 on hv-cinder-85752 Sep 14 01:12:30.805394 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-9127a19f-c749-42e7-80bc-c1acd279493c req-4da684b9-68d0-43b3-8c50-540a46562bf1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031788 Sep 14 01:12:30.806120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 416/828] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:12:32.522144 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-57aff6ec-9d74-4cf1-8e04-477a75d04267 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:32.522659 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-57aff6ec-9d74-4cf1-8e04-477a75d04267 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:32.528505 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-57aff6ec-9d74-4cf1-8e04-477a75d04267 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:32.528987 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-57aff6ec-9d74-4cf1-8e04-477a75d04267 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:32.529428 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-57aff6ec-9d74-4cf1-8e04-477a75d04267 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:32.530148 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-57aff6ec-9d74-4cf1-8e04-477a75d04267 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:32.530605 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-57aff6ec-9d74-4cf1-8e04-477a75d04267 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:32.531713 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-57aff6ec-9d74-4cf1-8e04-477a75d04267 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:32.610623 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-57aff6ec-9d74-4cf1-8e04-477a75d04267 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lazy-loading 'services' on Instance uuid 413d7106-fff0-4516-b70d-1d687312c9aa {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:12:32.680147 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-57aff6ec-9d74-4cf1-8e04-477a75d04267 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "DELETE /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa/os-volume_attachments/de8dc9db-36c3-4686-b36f-5f3775282013" status: 202 len: 0 microversion: 2.1 time: 0.162146 Sep 14 01:12:32.680751 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 413/829] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 01:12:32 2022] DELETE /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa/os-volume_attachments/de8dc9db-36c3-4686-b36f-5f3775282013 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:12:32.690445 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8598cc64-04ca-4596-9c5d-c5fbe1b639fd tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:32.692762 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8598cc64-04ca-4596-9c5d-c5fbe1b639fd tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:32.699649 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8598cc64-04ca-4596-9c5d-c5fbe1b639fd tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:32.700567 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8598cc64-04ca-4596-9c5d-c5fbe1b639fd tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:32.701124 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8598cc64-04ca-4596-9c5d-c5fbe1b639fd tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:32.701910 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8598cc64-04ca-4596-9c5d-c5fbe1b639fd tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:32.702430 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8598cc64-04ca-4596-9c5d-c5fbe1b639fd tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:32.703376 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8598cc64-04ca-4596-9c5d-c5fbe1b639fd tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:32.733955 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8598cc64-04ca-4596-9c5d-c5fbe1b639fd tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048328 Sep 14 01:12:32.734414 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 417/830] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 01:12:32 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:12:33.747032 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-34650816-6a85-4273-b0be-9915ab79afc3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:33.749895 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-34650816-6a85-4273-b0be-9915ab79afc3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:33.756112 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-34650816-6a85-4273-b0be-9915ab79afc3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:33.756583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-34650816-6a85-4273-b0be-9915ab79afc3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:33.757016 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-34650816-6a85-4273-b0be-9915ab79afc3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:33.757772 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-34650816-6a85-4273-b0be-9915ab79afc3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:33.758232 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-34650816-6a85-4273-b0be-9915ab79afc3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:33.758945 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-34650816-6a85-4273-b0be-9915ab79afc3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:33.789266 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-34650816-6a85-4273-b0be-9915ab79afc3 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047123 Sep 14 01:12:33.789817 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 414/831] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 01:12:33 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 01:12:33.876983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8fe1d623-3a1f-4379-a86b-102e1348fc3f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:33.877515 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8fe1d623-3a1f-4379-a86b-102e1348fc3f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:33.884147 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8fe1d623-3a1f-4379-a86b-102e1348fc3f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:33.884623 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8fe1d623-3a1f-4379-a86b-102e1348fc3f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:33.885053 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8fe1d623-3a1f-4379-a86b-102e1348fc3f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:33.885728 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8fe1d623-3a1f-4379-a86b-102e1348fc3f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:33.886178 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8fe1d623-3a1f-4379-a86b-102e1348fc3f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:33.886598 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8fe1d623-3a1f-4379-a86b-102e1348fc3f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:33.911884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8fe1d623-3a1f-4379-a86b-102e1348fc3f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Going to try to terminate instance {{(pid=120621) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:12:33.987461 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8fe1d623-3a1f-4379-a86b-102e1348fc3f tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "DELETE /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 204 len: 0 microversion: 2.1 time: 0.114768 Sep 14 01:12:33.988158 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 418/832] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:12:33 2022] DELETE /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 01:12:33.996938 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0059a107-923d-48d8-8ae5-1f6b322d0792 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:33.997594 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0059a107-923d-48d8-8ae5-1f6b322d0792 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:34.004370 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0059a107-923d-48d8-8ae5-1f6b322d0792 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:34.004851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0059a107-923d-48d8-8ae5-1f6b322d0792 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:34.005282 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0059a107-923d-48d8-8ae5-1f6b322d0792 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:34.005960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0059a107-923d-48d8-8ae5-1f6b322d0792 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:34.006410 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0059a107-923d-48d8-8ae5-1f6b322d0792 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:34.006828 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0059a107-923d-48d8-8ae5-1f6b322d0792 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:34.140577 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0059a107-923d-48d8-8ae5-1f6b322d0792 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:34.148300 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0059a107-923d-48d8-8ae5-1f6b322d0792 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1689 microversion: 2.1 time: 0.155344 Sep 14 01:12:34.148858 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 415/833] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:33 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:35.172001 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b4433bba-c123-434c-bd29-514a55b722cb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:35.172703 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b4433bba-c123-434c-bd29-514a55b722cb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:35.179042 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b4433bba-c123-434c-bd29-514a55b722cb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:35.179522 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b4433bba-c123-434c-bd29-514a55b722cb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:35.179989 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b4433bba-c123-434c-bd29-514a55b722cb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:35.180677 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b4433bba-c123-434c-bd29-514a55b722cb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:35.181160 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b4433bba-c123-434c-bd29-514a55b722cb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:35.181584 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b4433bba-c123-434c-bd29-514a55b722cb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:35.315113 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b4433bba-c123-434c-bd29-514a55b722cb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:35.322697 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b4433bba-c123-434c-bd29-514a55b722cb tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1689 microversion: 2.1 time: 0.154968 Sep 14 01:12:35.323309 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 419/834] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:35 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:36.347068 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d30cd7a1-3e8c-4039-a7a2-fbcdb88cce1a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:36.347700 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d30cd7a1-3e8c-4039-a7a2-fbcdb88cce1a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:36.354092 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d30cd7a1-3e8c-4039-a7a2-fbcdb88cce1a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:36.354574 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d30cd7a1-3e8c-4039-a7a2-fbcdb88cce1a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:36.355005 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d30cd7a1-3e8c-4039-a7a2-fbcdb88cce1a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:36.355727 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d30cd7a1-3e8c-4039-a7a2-fbcdb88cce1a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:36.356178 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d30cd7a1-3e8c-4039-a7a2-fbcdb88cce1a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:36.356599 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d30cd7a1-3e8c-4039-a7a2-fbcdb88cce1a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:36.483303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d30cd7a1-3e8c-4039-a7a2-fbcdb88cce1a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:36.490928 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d30cd7a1-3e8c-4039-a7a2-fbcdb88cce1a tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1689 microversion: 2.1 time: 0.148594 Sep 14 01:12:36.491466 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 416/835] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:36 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:37.514574 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e251146c-b39c-45ae-a4e6-36aa5940ec0c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:37.515254 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e251146c-b39c-45ae-a4e6-36aa5940ec0c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:37.522032 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e251146c-b39c-45ae-a4e6-36aa5940ec0c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:37.522521 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e251146c-b39c-45ae-a4e6-36aa5940ec0c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:37.522951 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e251146c-b39c-45ae-a4e6-36aa5940ec0c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:37.523824 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e251146c-b39c-45ae-a4e6-36aa5940ec0c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:37.524583 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e251146c-b39c-45ae-a4e6-36aa5940ec0c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:37.525313 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e251146c-b39c-45ae-a4e6-36aa5940ec0c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:37.665381 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e251146c-b39c-45ae-a4e6-36aa5940ec0c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:37.673709 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e251146c-b39c-45ae-a4e6-36aa5940ec0c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1689 microversion: 2.1 time: 0.162980 Sep 14 01:12:37.674285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 420/836] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:37 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:38.568760 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-e1b6f53e-bbac-434e-82c3-d88827f3559c req-34af5b6e-4d0b-48aa-b66e-c7958bad49e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413d7106-fff0-4516-b70d-1d687312c9aa", "name": "network-vif-deleted", "tag": "41e3c7ae-c1a9-4785-bdec-300c125b2082"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:12:38.574792 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:38.581292 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-e1b6f53e-bbac-434e-82c3-d88827f3559c req-34af5b6e-4d0b-48aa-b66e-c7958bad49e5 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:38.581769 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-e1b6f53e-bbac-434e-82c3-d88827f3559c req-34af5b6e-4d0b-48aa-b66e-c7958bad49e5 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:38.582201 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-e1b6f53e-bbac-434e-82c3-d88827f3559c req-34af5b6e-4d0b-48aa-b66e-c7958bad49e5 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:38.595100 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-e1b6f53e-bbac-434e-82c3-d88827f3559c req-34af5b6e-4d0b-48aa-b66e-c7958bad49e5 service nova] Creating event network-vif-deleted:41e3c7ae-c1a9-4785-bdec-300c125b2082 for instance 413d7106-fff0-4516-b70d-1d687312c9aa on hv-cinder-85752 Sep 14 01:12:38.600601 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-e1b6f53e-bbac-434e-82c3-d88827f3559c req-34af5b6e-4d0b-48aa-b66e-c7958bad49e5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035979 Sep 14 01:12:38.601203 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 417/837] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:12:38.697483 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a706110b-fa72-4e46-a6f7-98a7454ef7b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:38.698844 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a706110b-fa72-4e46-a6f7-98a7454ef7b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:38.708135 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a706110b-fa72-4e46-a6f7-98a7454ef7b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:38.708623 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a706110b-fa72-4e46-a6f7-98a7454ef7b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:38.709057 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a706110b-fa72-4e46-a6f7-98a7454ef7b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:38.709759 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a706110b-fa72-4e46-a6f7-98a7454ef7b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:38.710353 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a706110b-fa72-4e46-a6f7-98a7454ef7b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:38.710608 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a706110b-fa72-4e46-a6f7-98a7454ef7b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:38.748541 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a706110b-fa72-4e46-a6f7-98a7454ef7b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:38.749678 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a706110b-fa72-4e46-a6f7-98a7454ef7b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:38.750602 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a706110b-fa72-4e46-a6f7-98a7454ef7b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:38.751303 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-a706110b-fa72-4e46-a6f7-98a7454ef7b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lazy-loading 'fault' on Instance uuid 413d7106-fff0-4516-b70d-1d687312c9aa {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:12:38.799022 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a706110b-fa72-4e46-a6f7-98a7454ef7b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:38.808291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a706110b-fa72-4e46-a6f7-98a7454ef7b9 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 200 len: 1334 microversion: 2.1 time: 0.115065 Sep 14 01:12:38.820482 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 421/838] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:38 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 1334 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:39.833284 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2c05368c-c5cf-4c58-b915-9248b4d6ad9b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:39.833984 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2c05368c-c5cf-4c58-b915-9248b4d6ad9b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 413d7106-fff0-4516-b70d-1d687312c9aa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:39.840241 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2c05368c-c5cf-4c58-b915-9248b4d6ad9b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:39.840711 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2c05368c-c5cf-4c58-b915-9248b4d6ad9b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:39.841155 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2c05368c-c5cf-4c58-b915-9248b4d6ad9b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:39.841848 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2c05368c-c5cf-4c58-b915-9248b4d6ad9b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:39.842309 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2c05368c-c5cf-4c58-b915-9248b4d6ad9b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:39.842737 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2c05368c-c5cf-4c58-b915-9248b4d6ad9b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:39.857296 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-2c05368c-c5cf-4c58-b915-9248b4d6ad9b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] HTTP exception thrown: Instance 413d7106-fff0-4516-b70d-1d687312c9aa could not be found. Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2c05368c-c5cf-4c58-b915-9248b4d6ad9b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Request method failure captured: Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa HTTP/1.1 Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISi4inilP69TsQy2mm8Nh_IJQUYwZWgS8ICnEm1cj-smaP8bvo3DYC3hiD1vyg0oqkoMty-SG5kNH82xGIxyRzyUFloa1yf9CprF8FrUKT4AVz69xJpjqpXzcwegWPCIyPFW48HXkwwHrds38MJBEzqTje22LXfjItqk1TH9fQ_CyxA Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: d1dd868f069a46dbb6bfd549f6bbf7b8 Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2000797838 Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:12:39.859403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:12:39.861039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1dd868f069a46dbb6bfd549f6bbf7b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1dd868f069a46dbb6bfd549f6bbf7b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1dd868f069a46dbb6bfd549f6bbf7b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1dd868f069a46dbb6bfd549f6bbf7b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:12:39.861039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2000797838 Sep 14 01:12:39.861039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: d1dd868f069a46dbb6bfd549f6bbf7b8 Sep 14 01:12:39.861039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2000797838 Sep 14 01:12:39.861039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-ServerRescueNegativeTestJSON-2000797838-project Sep 14 01:12:39.861039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:12:39.861039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:12:39.861039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: bf73eca572454b88843785d791f0b471 Sep 14 01:12:39.861039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2000797838-project Sep 14 01:12:39.861039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:12:39.861039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance 413d7106-fff0-4516-b70d-1d687312c9aa could not be found. Sep 14 01:12:39.861039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': '413d7106-fff0-4516-b70d-1d687312c9aa'} Sep 14 01:12:39.861867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:12:39.861867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:12:39.861867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:12:39.861867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:12:39.861867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:12:39.861867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:12:39.861867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:12:39.861867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:12:39.861867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:12:39.861867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:12:39.861867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 413d7106-fff0-4516-b70d-1d687312c9aa could not be found. Sep 14 01:12:39.861867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:12:39.861867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:12:39.861867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:12:39.861867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:12:39.861867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:12:39.861867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:12:39.861867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:12:39.861867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:12:39.861867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:12:39.863301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:12:39.863301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:12:39.863301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:12:39.863301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:12:39.863301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:12:39.863301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:12:39.863301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:12:39.863301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 413d7106-fff0-4516-b70d-1d687312c9aa could not be found. Sep 14 01:12:39.863301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:12:39.863301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:12:39.863301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:12:39.863301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:12:39.863301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:12:39.863301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:12:39.863301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:12:39.863301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:12:39.863301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 413d7106-fff0-4516-b70d-1d687312c9aa could not be found. Sep 14 01:12:39.863301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:12:39.864603 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2c05368c-c5cf-4c58-b915-9248b4d6ad9b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Returning 404 to user: Instance 413d7106-fff0-4516-b70d-1d687312c9aa could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:12:39.864603 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2c05368c-c5cf-4c58-b915-9248b4d6ad9b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa" status: 404 len: 111 microversion: 2.1 time: 0.032276 Sep 14 01:12:39.864603 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 418/839] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:39 2022] GET /compute/v2.1/servers/413d7106-fff0-4516-b70d-1d687312c9aa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:12:39.869365 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-df34a921-ca4f-4c33-9239-45f28a420000 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '.version_select at 0x7f5043d0f280>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:39.889396 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-df34a921-ca4f-4c33-9239-45f28a420000 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-269254312" status: 202 len: 0 microversion: 2.1 time: 0.023727 Sep 14 01:12:39.889920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 422/840] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Sep 14 01:12:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-269254312 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:12:42.757431 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d3702f1d-38e1-445b-9303-b2bc081f0d7c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:42.757929 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d3702f1d-38e1-445b-9303-b2bc081f0d7c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:42.764671 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d3702f1d-38e1-445b-9303-b2bc081f0d7c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:42.765162 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d3702f1d-38e1-445b-9303-b2bc081f0d7c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:42.765604 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d3702f1d-38e1-445b-9303-b2bc081f0d7c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:42.766347 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d3702f1d-38e1-445b-9303-b2bc081f0d7c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:42.766900 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d3702f1d-38e1-445b-9303-b2bc081f0d7c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:42.767332 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d3702f1d-38e1-445b-9303-b2bc081f0d7c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:42.943517 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d3702f1d-38e1-445b-9303-b2bc081f0d7c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Going to try to terminate instance {{(pid=120620) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:12:43.015265 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d3702f1d-38e1-445b-9303-b2bc081f0d7c tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "DELETE /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 204 len: 0 microversion: 2.1 time: 0.261275 Sep 14 01:12:43.015917 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 419/841] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:12:42 2022] DELETE /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 01:12:43.025540 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2c5016dc-66e9-4b25-8f73-a73c56af36b5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:43.026172 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2c5016dc-66e9-4b25-8f73-a73c56af36b5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:43.033564 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2c5016dc-66e9-4b25-8f73-a73c56af36b5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:43.034049 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2c5016dc-66e9-4b25-8f73-a73c56af36b5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:43.034484 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2c5016dc-66e9-4b25-8f73-a73c56af36b5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:43.035180 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2c5016dc-66e9-4b25-8f73-a73c56af36b5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:43.035666 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2c5016dc-66e9-4b25-8f73-a73c56af36b5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:43.036093 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2c5016dc-66e9-4b25-8f73-a73c56af36b5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:43.166957 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2c5016dc-66e9-4b25-8f73-a73c56af36b5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:43.175356 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2c5016dc-66e9-4b25-8f73-a73c56af36b5 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1507 microversion: 2.1 time: 0.154243 Sep 14 01:12:43.175945 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 423/842] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:43 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:44.200268 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-41d60b10-3f5c-4ca3-92d3-8f682d12fbdf tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:44.200986 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-41d60b10-3f5c-4ca3-92d3-8f682d12fbdf tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:44.208011 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-41d60b10-3f5c-4ca3-92d3-8f682d12fbdf tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:44.208499 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-41d60b10-3f5c-4ca3-92d3-8f682d12fbdf tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:44.208939 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-41d60b10-3f5c-4ca3-92d3-8f682d12fbdf tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:44.209622 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-41d60b10-3f5c-4ca3-92d3-8f682d12fbdf tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:44.210091 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-41d60b10-3f5c-4ca3-92d3-8f682d12fbdf tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:44.210639 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-41d60b10-3f5c-4ca3-92d3-8f682d12fbdf tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:44.430753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-41d60b10-3f5c-4ca3-92d3-8f682d12fbdf tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:44.439695 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-41d60b10-3f5c-4ca3-92d3-8f682d12fbdf tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 200 len: 1507 microversion: 2.1 time: 0.243543 Sep 14 01:12:44.440260 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 420/843] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:44 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 1507 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:44.695026 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-97027912-4f2f-4e19-baed-96b047e5f214 req-31974fd5-42bf-41fa-9077-f830a3425051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa", "name": "network-vif-deleted", "tag": "0f1f31eb-05bc-4b3d-995e-4fba37dfe847"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:12:44.707881 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-97027912-4f2f-4e19-baed-96b047e5f214 req-31974fd5-42bf-41fa-9077-f830a3425051 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:44.708362 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-97027912-4f2f-4e19-baed-96b047e5f214 req-31974fd5-42bf-41fa-9077-f830a3425051 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:44.708790 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-97027912-4f2f-4e19-baed-96b047e5f214 req-31974fd5-42bf-41fa-9077-f830a3425051 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:44.720475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-97027912-4f2f-4e19-baed-96b047e5f214 req-31974fd5-42bf-41fa-9077-f830a3425051 service nova] Creating event network-vif-deleted:0f1f31eb-05bc-4b3d-995e-4fba37dfe847 for instance 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa on hv-cinder-85752 Sep 14 01:12:44.726219 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-97027912-4f2f-4e19-baed-96b047e5f214 req-31974fd5-42bf-41fa-9077-f830a3425051 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034878 Sep 14 01:12:44.727023 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 424/844] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:12:45.472017 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d41c3839-016d-45f2-92e2-0663b0f09a43 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:45.472740 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d41c3839-016d-45f2-92e2-0663b0f09a43 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:45.480289 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d41c3839-016d-45f2-92e2-0663b0f09a43 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:45.480788 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d41c3839-016d-45f2-92e2-0663b0f09a43 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:45.481233 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d41c3839-016d-45f2-92e2-0663b0f09a43 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:45.482165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d41c3839-016d-45f2-92e2-0663b0f09a43 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:45.482627 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d41c3839-016d-45f2-92e2-0663b0f09a43 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:45.483273 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d41c3839-016d-45f2-92e2-0663b0f09a43 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:45.497100 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-d41c3839-016d-45f2-92e2-0663b0f09a43 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] HTTP exception thrown: Instance 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa could not be found. Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d41c3839-016d-45f2-92e2-0663b0f09a43 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Request method failure captured: Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa HTTP/1.1 Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISi4inilP69TsQy2mm8Nh_IJQUYwZWgS8ICnEm1cj-smaP8bvo3DYC3hiD1vyg0oqkoMty-SG5kNH82xGIxyRzyUFloa1yf9CprF8FrUKT4AVz69xJpjqpXzcwegWPCIyPFW48HXkwwHrds38MJBEzqTje22LXfjItqk1TH9fQ_CyxA Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: d1dd868f069a46dbb6bfd549f6bbf7b8 Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2000797838 Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:12:45.498749 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:12:45.500187 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1dd868f069a46dbb6bfd549f6bbf7b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1dd868f069a46dbb6bfd549f6bbf7b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1dd868f069a46dbb6bfd549f6bbf7b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1dd868f069a46dbb6bfd549f6bbf7b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:12:45.500187 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2000797838 Sep 14 01:12:45.500187 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: d1dd868f069a46dbb6bfd549f6bbf7b8 Sep 14 01:12:45.500187 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2000797838 Sep 14 01:12:45.500187 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-ServerRescueNegativeTestJSON-2000797838-project Sep 14 01:12:45.500187 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:12:45.500187 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:12:45.500187 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: bf73eca572454b88843785d791f0b471 Sep 14 01:12:45.500187 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2000797838-project Sep 14 01:12:45.500187 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:12:45.500187 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa could not be found. Sep 14 01:12:45.500187 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': '39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa'} Sep 14 01:12:45.500962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:12:45.500962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:12:45.500962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:12:45.500962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:12:45.500962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:12:45.500962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:12:45.500962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:12:45.500962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:12:45.500962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:12:45.500962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:12:45.500962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa could not be found. Sep 14 01:12:45.500962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:12:45.500962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:12:45.500962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:12:45.500962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:12:45.500962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:12:45.500962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:12:45.500962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:12:45.500962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:12:45.500962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:12:45.502437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:12:45.502437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:12:45.502437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:12:45.502437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:12:45.502437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:12:45.502437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:12:45.502437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:12:45.502437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa could not be found. Sep 14 01:12:45.502437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:12:45.502437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:12:45.502437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:12:45.502437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:12:45.502437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:12:45.502437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:12:45.502437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:12:45.502437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:12:45.502437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa could not be found. Sep 14 01:12:45.502437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:12:45.503614 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d41c3839-016d-45f2-92e2-0663b0f09a43 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Returning 404 to user: Instance 39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:12:45.503614 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d41c3839-016d-45f2-92e2-0663b0f09a43 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa" status: 404 len: 111 microversion: 2.1 time: 0.037483 Sep 14 01:12:45.503614 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 421/845] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:45 2022] GET /compute/v2.1/servers/39e7a0cf-f14b-43dd-ac23-4e1d111f7dfa => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:12:45.510270 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a14c7663-baed-482d-a68b-28f8ea5b07a7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:45.511065 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a14c7663-baed-482d-a68b-28f8ea5b07a7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:45.518924 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a14c7663-baed-482d-a68b-28f8ea5b07a7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:45.519412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a14c7663-baed-482d-a68b-28f8ea5b07a7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:45.519871 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a14c7663-baed-482d-a68b-28f8ea5b07a7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:45.520577 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a14c7663-baed-482d-a68b-28f8ea5b07a7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:45.521003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a14c7663-baed-482d-a68b-28f8ea5b07a7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:45.521424 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a14c7663-baed-482d-a68b-28f8ea5b07a7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:45.546677 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a14c7663-baed-482d-a68b-28f8ea5b07a7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Going to try to terminate instance {{(pid=120621) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:12:45.590725 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:45.621935 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a14c7663-baed-482d-a68b-28f8ea5b07a7 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "DELETE /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 204 len: 0 microversion: 2.1 time: 0.116108 Sep 14 01:12:45.622533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 425/846] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:12:45 2022] DELETE /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 01:12:45.630959 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-651ed9c5-3d41-4e89-86ea-412ec3b77a6e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:45.631643 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-651ed9c5-3d41-4e89-86ea-412ec3b77a6e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:45.637843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-651ed9c5-3d41-4e89-86ea-412ec3b77a6e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:45.638333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-651ed9c5-3d41-4e89-86ea-412ec3b77a6e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:45.638802 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-651ed9c5-3d41-4e89-86ea-412ec3b77a6e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:45.639499 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-651ed9c5-3d41-4e89-86ea-412ec3b77a6e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:45.639995 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-651ed9c5-3d41-4e89-86ea-412ec3b77a6e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:45.640420 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-651ed9c5-3d41-4e89-86ea-412ec3b77a6e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:45.769548 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-651ed9c5-3d41-4e89-86ea-412ec3b77a6e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:45.777108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-651ed9c5-3d41-4e89-86ea-412ec3b77a6e tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.150337 Sep 14 01:12:45.777652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 422/847] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:45 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:12:46.802107 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-99a830d1-4b94-4905-b00e-5bee63165d08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:46.802818 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-99a830d1-4b94-4905-b00e-5bee63165d08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:46.809088 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99a830d1-4b94-4905-b00e-5bee63165d08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:46.809570 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99a830d1-4b94-4905-b00e-5bee63165d08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:46.810005 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99a830d1-4b94-4905-b00e-5bee63165d08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:46.810701 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99a830d1-4b94-4905-b00e-5bee63165d08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:46.811155 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99a830d1-4b94-4905-b00e-5bee63165d08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:46.811593 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-99a830d1-4b94-4905-b00e-5bee63165d08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:46.946785 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-99a830d1-4b94-4905-b00e-5bee63165d08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf73eca572454b88843785d791f0b471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1dd868f069a46dbb6bfd549f6bbf7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:46.954658 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-99a830d1-4b94-4905-b00e-5bee63165d08 tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 200 len: 1522 microversion: 2.1 time: 0.157356 Sep 14 01:12:46.955486 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 426/848] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:46 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:47.037757 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-8a4dd179-e43b-464d-a418-3bae4a192a8e req-98f9f6c7-cca4-4d72-8361-c7212c7cb100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96664d10-3eeb-4172-b866-7d824c2310d3", "name": "network-vif-deleted", "tag": "dd7f3405-9f9e-4062-a010-7d8bae1bc828"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:12:47.047640 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-8a4dd179-e43b-464d-a418-3bae4a192a8e req-98f9f6c7-cca4-4d72-8361-c7212c7cb100 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:47.048042 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-8a4dd179-e43b-464d-a418-3bae4a192a8e req-98f9f6c7-cca4-4d72-8361-c7212c7cb100 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:47.049189 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-8a4dd179-e43b-464d-a418-3bae4a192a8e req-98f9f6c7-cca4-4d72-8361-c7212c7cb100 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:47.061743 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-8a4dd179-e43b-464d-a418-3bae4a192a8e req-98f9f6c7-cca4-4d72-8361-c7212c7cb100 service nova] Creating event network-vif-deleted:dd7f3405-9f9e-4062-a010-7d8bae1bc828 for instance 96664d10-3eeb-4172-b866-7d824c2310d3 on hv-cinder-85752 Sep 14 01:12:47.067848 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-8a4dd179-e43b-464d-a418-3bae4a192a8e req-98f9f6c7-cca4-4d72-8361-c7212c7cb100 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034711 Sep 14 01:12:47.068461 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 423/849] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:12:47.978229 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-509a6b6a-ee74-4e49-8dd2-3559e772894b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:47.978866 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-509a6b6a-ee74-4e49-8dd2-3559e772894b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] [instance: 96664d10-3eeb-4172-b866-7d824c2310d3] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:47.985358 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-509a6b6a-ee74-4e49-8dd2-3559e772894b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:47.985861 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-509a6b6a-ee74-4e49-8dd2-3559e772894b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:47.986278 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-509a6b6a-ee74-4e49-8dd2-3559e772894b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:47.987019 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-509a6b6a-ee74-4e49-8dd2-3559e772894b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:47.987430 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-509a6b6a-ee74-4e49-8dd2-3559e772894b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:47.987878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-509a6b6a-ee74-4e49-8dd2-3559e772894b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:48.001097 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-509a6b6a-ee74-4e49-8dd2-3559e772894b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] HTTP exception thrown: Instance 96664d10-3eeb-4172-b866-7d824c2310d3 could not be found. Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-509a6b6a-ee74-4e49-8dd2-3559e772894b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Request method failure captured: Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 HTTP/1.1 Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISi4inilP69TsQy2mm8Nh_IJQUYwZWgS8ICnEm1cj-smaP8bvo3DYC3hiD1vyg0oqkoMty-SG5kNH82xGIxyRzyUFloa1yf9CprF8FrUKT4AVz69xJpjqpXzcwegWPCIyPFW48HXkwwHrds38MJBEzqTje22LXfjItqk1TH9fQ_CyxA Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: d1dd868f069a46dbb6bfd549f6bbf7b8 Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2000797838 Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:12:48.003245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:12:48.004879 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1dd868f069a46dbb6bfd549f6bbf7b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1dd868f069a46dbb6bfd549f6bbf7b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1dd868f069a46dbb6bfd549f6bbf7b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1dd868f069a46dbb6bfd549f6bbf7b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:12:48.004879 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2000797838 Sep 14 01:12:48.004879 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: d1dd868f069a46dbb6bfd549f6bbf7b8 Sep 14 01:12:48.004879 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2000797838 Sep 14 01:12:48.004879 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-ServerRescueNegativeTestJSON-2000797838-project Sep 14 01:12:48.004879 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:12:48.004879 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:12:48.004879 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: bf73eca572454b88843785d791f0b471 Sep 14 01:12:48.004879 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2000797838-project Sep 14 01:12:48.004879 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:12:48.004879 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Instance 96664d10-3eeb-4172-b866-7d824c2310d3 could not be found. Sep 14 01:12:48.004879 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': '96664d10-3eeb-4172-b866-7d824c2310d3'} Sep 14 01:12:48.005733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:12:48.005733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:12:48.005733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:12:48.005733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:12:48.005733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:12:48.005733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:12:48.005733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:12:48.005733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:12:48.005733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:12:48.005733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:12:48.005733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96664d10-3eeb-4172-b866-7d824c2310d3 could not be found. Sep 14 01:12:48.005733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:12:48.005733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:12:48.005733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:12:48.005733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:12:48.005733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:12:48.005733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:12:48.005733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:12:48.005733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:12:48.005733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:12:48.007168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:12:48.007168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:12:48.007168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:12:48.007168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:12:48.007168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:12:48.007168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:12:48.007168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:12:48.007168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96664d10-3eeb-4172-b866-7d824c2310d3 could not be found. Sep 14 01:12:48.007168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:12:48.007168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:12:48.007168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:12:48.007168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:12:48.007168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:12:48.007168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:12:48.007168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:12:48.007168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:12:48.007168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96664d10-3eeb-4172-b866-7d824c2310d3 could not be found. Sep 14 01:12:48.007168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:12:48.008859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-509a6b6a-ee74-4e49-8dd2-3559e772894b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] Returning 404 to user: Instance 96664d10-3eeb-4172-b866-7d824c2310d3 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:12:48.008859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-509a6b6a-ee74-4e49-8dd2-3559e772894b tempest-ServerRescueNegativeTestJSON-2000797838 tempest-ServerRescueNegativeTestJSON-2000797838-project] 10.222.0.42 "GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3" status: 404 len: 111 microversion: 2.1 time: 0.030373 Sep 14 01:12:48.008859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 427/850] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:47 2022] GET /compute/v2.1/servers/96664d10-3eeb-4172-b866-7d824c2310d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:12:49.880539 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8189c9a5-2da3-4523-82a4-0c1ed06b8d47 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:49.882917 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8189c9a5-2da3-4523-82a4-0c1ed06b8d47 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:49.889573 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8189c9a5-2da3-4523-82a4-0c1ed06b8d47 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:49.890072 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8189c9a5-2da3-4523-82a4-0c1ed06b8d47 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:49.890514 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8189c9a5-2da3-4523-82a4-0c1ed06b8d47 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:49.891219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8189c9a5-2da3-4523-82a4-0c1ed06b8d47 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:49.891720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8189c9a5-2da3-4523-82a4-0c1ed06b8d47 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:49.892142 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8189c9a5-2da3-4523-82a4-0c1ed06b8d47 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:49.924474 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8189c9a5-2da3-4523-82a4-0c1ed06b8d47 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048251 Sep 14 01:12:49.927886 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 424/851] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 01:12:49 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 01:12:49.992973 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-53530322-ea21-4b5f-a8d6-a64c5ff77e89 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:49.993753 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-53530322-ea21-4b5f-a8d6-a64c5ff77e89 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:49.997659 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:50.003532 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53530322-ea21-4b5f-a8d6-a64c5ff77e89 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:50.004071 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53530322-ea21-4b5f-a8d6-a64c5ff77e89 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:50.004516 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53530322-ea21-4b5f-a8d6-a64c5ff77e89 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:50.005218 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53530322-ea21-4b5f-a8d6-a64c5ff77e89 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:50.005676 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53530322-ea21-4b5f-a8d6-a64c5ff77e89 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:50.006103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-53530322-ea21-4b5f-a8d6-a64c5ff77e89 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:50.036454 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-53530322-ea21-4b5f-a8d6-a64c5ff77e89 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Going to try to terminate instance {{(pid=120621) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:12:50.123048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-53530322-ea21-4b5f-a8d6-a64c5ff77e89 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 204 len: 0 microversion: 2.1 time: 0.133248 Sep 14 01:12:50.128518 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 428/852] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:12:49 2022] DELETE /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 01:12:50.132891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-fbb2c8e1-fcb4-4442-b0d8-596b942d9711 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:50.133954 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-fbb2c8e1-fcb4-4442-b0d8-596b942d9711 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:50.141690 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fbb2c8e1-fcb4-4442-b0d8-596b942d9711 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:50.151861 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fbb2c8e1-fcb4-4442-b0d8-596b942d9711 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:50.152803 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fbb2c8e1-fcb4-4442-b0d8-596b942d9711 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:50.153732 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fbb2c8e1-fcb4-4442-b0d8-596b942d9711 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:50.154459 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fbb2c8e1-fcb4-4442-b0d8-596b942d9711 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:50.156301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fbb2c8e1-fcb4-4442-b0d8-596b942d9711 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:50.325563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-fbb2c8e1-fcb4-4442-b0d8-596b942d9711 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:50.334640 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-fbb2c8e1-fcb4-4442-b0d8-596b942d9711 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1671 microversion: 2.1 time: 0.205540 Sep 14 01:12:50.335250 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 425/853] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:50 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1671 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:51.362243 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-56ccb063-89dc-4429-bbb3-8bdb2423d785 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:51.362948 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-56ccb063-89dc-4429-bbb3-8bdb2423d785 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:51.373302 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56ccb063-89dc-4429-bbb3-8bdb2423d785 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:51.373788 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56ccb063-89dc-4429-bbb3-8bdb2423d785 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:51.374305 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56ccb063-89dc-4429-bbb3-8bdb2423d785 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:51.375194 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56ccb063-89dc-4429-bbb3-8bdb2423d785 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:51.375847 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56ccb063-89dc-4429-bbb3-8bdb2423d785 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:51.376452 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56ccb063-89dc-4429-bbb3-8bdb2423d785 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:51.560460 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-56ccb063-89dc-4429-bbb3-8bdb2423d785 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:51.571063 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-56ccb063-89dc-4429-bbb3-8bdb2423d785 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1671 microversion: 2.1 time: 0.216137 Sep 14 01:12:51.584131 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 429/854] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:51 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1671 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:52.540415 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-c4c554a9-fbdf-4815-b5ee-03c171c04c94 req-b009c2a3-8652-47c9-899b-8db5b5abf69d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e701782-aa36-44dd-be23-a59054d8cb32", "name": "network-vif-deleted", "tag": "620985b6-d85e-4dfc-884a-1a64043ee00d"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:12:52.552258 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-c4c554a9-fbdf-4815-b5ee-03c171c04c94 req-b009c2a3-8652-47c9-899b-8db5b5abf69d service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:52.553074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-c4c554a9-fbdf-4815-b5ee-03c171c04c94 req-b009c2a3-8652-47c9-899b-8db5b5abf69d service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:52.553725 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-c4c554a9-fbdf-4815-b5ee-03c171c04c94 req-b009c2a3-8652-47c9-899b-8db5b5abf69d service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:52.567895 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-c4c554a9-fbdf-4815-b5ee-03c171c04c94 req-b009c2a3-8652-47c9-899b-8db5b5abf69d service nova] Creating event network-vif-deleted:620985b6-d85e-4dfc-884a-1a64043ee00d for instance 5e701782-aa36-44dd-be23-a59054d8cb32 on hv-cinder-85752 Sep 14 01:12:52.573698 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-c4c554a9-fbdf-4815-b5ee-03c171c04c94 req-b009c2a3-8652-47c9-899b-8db5b5abf69d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039337 Sep 14 01:12:52.574669 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 426/855] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:12:52.598333 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-22b1bf89-4078-4aca-a866-6e83c39ac31b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:52.598953 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-22b1bf89-4078-4aca-a866-6e83c39ac31b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:52.607619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-22b1bf89-4078-4aca-a866-6e83c39ac31b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:52.608110 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-22b1bf89-4078-4aca-a866-6e83c39ac31b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:52.608542 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-22b1bf89-4078-4aca-a866-6e83c39ac31b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:52.609245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-22b1bf89-4078-4aca-a866-6e83c39ac31b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:52.609714 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-22b1bf89-4078-4aca-a866-6e83c39ac31b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:52.610120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-22b1bf89-4078-4aca-a866-6e83c39ac31b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:52.705309 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-22b1bf89-4078-4aca-a866-6e83c39ac31b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:52.726745 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-22b1bf89-4078-4aca-a866-6e83c39ac31b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1322 microversion: 2.1 time: 0.129514 Sep 14 01:12:52.728432 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 430/856] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:52 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1322 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:53.757964 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-cfb15c16-bdfe-4aa4-b60e-7e5ec54c75be tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:53.759719 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-cfb15c16-bdfe-4aa4-b60e-7e5ec54c75be tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:53.767751 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cfb15c16-bdfe-4aa4-b60e-7e5ec54c75be tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:53.768574 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cfb15c16-bdfe-4aa4-b60e-7e5ec54c75be tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:53.769369 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cfb15c16-bdfe-4aa4-b60e-7e5ec54c75be tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:53.770304 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cfb15c16-bdfe-4aa4-b60e-7e5ec54c75be tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:53.770848 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cfb15c16-bdfe-4aa4-b60e-7e5ec54c75be tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:53.771335 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cfb15c16-bdfe-4aa4-b60e-7e5ec54c75be tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:53.824570 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cfb15c16-bdfe-4aa4-b60e-7e5ec54c75be tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:53.825051 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cfb15c16-bdfe-4aa4-b60e-7e5ec54c75be tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:53.825654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cfb15c16-bdfe-4aa4-b60e-7e5ec54c75be tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:53.826128 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-cfb15c16-bdfe-4aa4-b60e-7e5ec54c75be tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lazy-loading 'fault' on Instance uuid 5e701782-aa36-44dd-be23-a59054d8cb32 {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:12:53.871231 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-cfb15c16-bdfe-4aa4-b60e-7e5ec54c75be tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:53.879242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-cfb15c16-bdfe-4aa4-b60e-7e5ec54c75be tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 200 len: 1327 microversion: 2.1 time: 0.126206 Sep 14 01:12:53.879860 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 427/857] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:53 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 1327 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:12:54.903340 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c06b7836-3b73-48de-a08c-e58e4e7b85c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:54.904008 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c06b7836-3b73-48de-a08c-e58e4e7b85c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:54.910907 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c06b7836-3b73-48de-a08c-e58e4e7b85c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:54.911398 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c06b7836-3b73-48de-a08c-e58e4e7b85c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:54.911864 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c06b7836-3b73-48de-a08c-e58e4e7b85c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:54.912553 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c06b7836-3b73-48de-a08c-e58e4e7b85c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:54.913007 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c06b7836-3b73-48de-a08c-e58e4e7b85c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:54.913431 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c06b7836-3b73-48de-a08c-e58e4e7b85c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:54.926784 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-c06b7836-3b73-48de-a08c-e58e4e7b85c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] HTTP exception thrown: Instance 5e701782-aa36-44dd-be23-a59054d8cb32 could not be found. Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c06b7836-3b73-48de-a08c-e58e4e7b85c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Request method failure captured: Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 HTTP/1.1 Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISi0xwKkVlqJjAxVxF7ZmdIDRsYSBScRRHN0QLfKSrZcd-i94MQR-bczycroD2TwO7aShD29dyw1atijMWxpkGQvLL205B8oNgcqcmvzSuVNKxb-hZ9GSKA3m2qhBfRG33LfCPhhGK-iTW71D6_0-F7OQ9w7kEOTi31PdC3XgaqhlqE Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 25c229f6a4574619a73b2780d2a6528b Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeTestJSON-1929180449 Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:12:54.928413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:12:54.930030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:12:54.930030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeTestJSON-1929180449 Sep 14 01:12:54.930030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 25c229f6a4574619a73b2780d2a6528b Sep 14 01:12:54.930030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1929180449 Sep 14 01:12:54.930030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeTestJSON-1929180449-project Sep 14 01:12:54.930030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:12:54.930030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:12:54.930030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: 2eca12e1e0a64eeeb183a328f338f54d Sep 14 01:12:54.930030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeTestJSON-1929180449-project Sep 14 01:12:54.930030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:12:54.930030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Instance 5e701782-aa36-44dd-be23-a59054d8cb32 could not be found. Sep 14 01:12:54.930030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': '5e701782-aa36-44dd-be23-a59054d8cb32'} Sep 14 01:12:54.931134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:12:54.931134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:12:54.931134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:12:54.931134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:12:54.931134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:12:54.931134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:12:54.931134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:12:54.931134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:12:54.931134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:12:54.931134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:12:54.931134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e701782-aa36-44dd-be23-a59054d8cb32 could not be found. Sep 14 01:12:54.931134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:12:54.931134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:12:54.931134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:12:54.931134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:12:54.931134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:12:54.931134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:12:54.931134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:12:54.931134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:12:54.931134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:12:54.932629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:12:54.932629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:12:54.932629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:12:54.932629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:12:54.932629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:12:54.932629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:12:54.932629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:12:54.932629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e701782-aa36-44dd-be23-a59054d8cb32 could not be found. Sep 14 01:12:54.932629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:12:54.932629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:12:54.932629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:12:54.932629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:12:54.932629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:12:54.932629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:12:54.932629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:12:54.932629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:12:54.932629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e701782-aa36-44dd-be23-a59054d8cb32 could not be found. Sep 14 01:12:54.932629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:12:54.934293 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c06b7836-3b73-48de-a08c-e58e4e7b85c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Returning 404 to user: Instance 5e701782-aa36-44dd-be23-a59054d8cb32 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:12:54.934293 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c06b7836-3b73-48de-a08c-e58e4e7b85c8 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 404 len: 111 microversion: 2.1 time: 0.030585 Sep 14 01:12:54.934293 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 431/858] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:54 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:12:54.940152 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-3102eb3f-24d3-4873-baeb-f24500bc2922 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '.version_select at 0x7f5043cbde50>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:54.961179 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-3102eb3f-24d3-4873-baeb-f24500bc2922 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1814663207" status: 202 len: 0 microversion: 2.1 time: 0.026079 Sep 14 01:12:54.961744 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 428/859] 10.222.0.42 () {58 vars in 1221 bytes} [Wed Sep 14 01:12:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1814663207 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:12:55.587825 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5ce0a2ea-55d7-4566-9013-b34ee2bba93f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Action: 'create', calling method: .version_select at 0x7f5043c645e0>, body: {"keypair": {"name": "tempest-keypair-796132565", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2Ujv7Pej/lxzZaxOKnwLHHrBBC9mA3lE4GsGssbj30oZticmn/9WNHR+cZHCNl0dFgUsGi21ZNa0pV7BqP5HwuYs7WS7j/4/fxN6xz9QJhxiQZJlZgo5oUzgaGl2yhYA=="}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:12:55.603802 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-5ce0a2ea-55d7-4566-9013-b34ee2bba93f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Getting quotas for project 25c229f6a4574619a73b2780d2a6528b. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:12:55.607517 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-5ce0a2ea-55d7-4566-9013-b34ee2bba93f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Getting quotas for user 2eca12e1e0a64eeeb183a328f338f54d and project 25c229f6a4574619a73b2780d2a6528b. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:12:55.629156 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5ce0a2ea-55d7-4566-9013-b34ee2bba93f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045245 Sep 14 01:12:55.629736 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 432/860] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Sep 14 01:12:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:12:56.932016 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2de2cd53-29b3-436c-9222-25596ff8dce2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-624504115", "imageRef": "a2619027-0d8b-4ca3-9528-1ac3380cab5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "740eb1f7-47cc-47b7-ac3a-115438e4b57e"}], "security_groups": [{"name": "tempest-securitygroup--1751148381"}], "key_name": "tempest-keypair-796132565", "user_data": "}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:12:57.038529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.network.neutron [None req-2de2cd53-29b3-436c-9222-25596ff8dce2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] validate_networks() for [('740eb1f7-47cc-47b7-ac3a-115438e4b57e', None, None, None, None, None)] {{(pid=120620) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:12:57.640692 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-2de2cd53-29b3-436c-9222-25596ff8dce2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Flavor limits 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:12:57.641272 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-2de2cd53-29b3-436c-9222-25596ff8dce2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Image limits 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:12:57.641846 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-2de2cd53-29b3-436c-9222-25596ff8dce2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Flavor pref 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:12:57.643031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-2de2cd53-29b3-436c-9222-25596ff8dce2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Image pref 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:12:57.643538 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-2de2cd53-29b3-436c-9222-25596ff8dce2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:12:57.652695 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2de2cd53-29b3-436c-9222-25596ff8dce2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:57.653393 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2de2cd53-29b3-436c-9222-25596ff8dce2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:57.653828 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2de2cd53-29b3-436c-9222-25596ff8dce2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:57.654560 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2de2cd53-29b3-436c-9222-25596ff8dce2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:57.655112 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2de2cd53-29b3-436c-9222-25596ff8dce2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:57.655574 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2de2cd53-29b3-436c-9222-25596ff8dce2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:57.674037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-2de2cd53-29b3-436c-9222-25596ff8dce2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Getting quotas for project 25c229f6a4574619a73b2780d2a6528b. Resources: {'cores', 'instances', 'ram'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:12:57.678046 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-2de2cd53-29b3-436c-9222-25596ff8dce2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Getting quotas for user 2eca12e1e0a64eeeb183a328f338f54d and project 25c229f6a4574619a73b2780d2a6528b. Resources: {'cores', 'instances', 'ram'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:12:57.689280 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2de2cd53-29b3-436c-9222-25596ff8dce2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Going to run 1 instances... {{(pid=120620) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:12:57.691764 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2de2cd53-29b3-436c-9222-25596ff8dce2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a2619027-0d8b-4ca3-9528-1ac3380cab5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120620) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:12:57.739186 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2de2cd53-29b3-436c-9222-25596ff8dce2 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.811931 Sep 14 01:12:57.740128 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 429/861] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 01:12:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 01:12:57.751961 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c912eeec-e257-4aba-9938-bb6c763dbd37 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:57.752813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c912eeec-e257-4aba-9938-bb6c763dbd37 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:57.828373 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c912eeec-e257-4aba-9938-bb6c763dbd37 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:57.836868 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c912eeec-e257-4aba-9938-bb6c763dbd37 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d" status: 200 len: 1236 microversion: 2.1 time: 0.089787 Sep 14 01:12:57.839973 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 433/862] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:57 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d => generated 1236 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:12:58.861715 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-adfcb1e4-d56c-46b1-8367-928250234300 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:12:58.862269 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-adfcb1e4-d56c-46b1-8367-928250234300 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:12:58.868261 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-adfcb1e4-d56c-46b1-8367-928250234300 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:58.868762 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-adfcb1e4-d56c-46b1-8367-928250234300 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:58.869277 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-adfcb1e4-d56c-46b1-8367-928250234300 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:58.869981 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-adfcb1e4-d56c-46b1-8367-928250234300 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:12:58.870440 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-adfcb1e4-d56c-46b1-8367-928250234300 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:12:58.870863 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-adfcb1e4-d56c-46b1-8367-928250234300 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:12:58.873602 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:12:58.984483 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-adfcb1e4-d56c-46b1-8367-928250234300 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:12:58.994140 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-adfcb1e4-d56c-46b1-8367-928250234300 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d" status: 200 len: 1296 microversion: 2.1 time: 0.137444 Sep 14 01:12:58.995356 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 430/863] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:12:58 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d => generated 1296 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:00.020869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d2d4285e-6df0-468a-a71f-d5ceaadf4882 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:00.021499 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d2d4285e-6df0-468a-a71f-d5ceaadf4882 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:00.028172 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d2d4285e-6df0-468a-a71f-d5ceaadf4882 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:00.028658 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d2d4285e-6df0-468a-a71f-d5ceaadf4882 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:00.029092 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d2d4285e-6df0-468a-a71f-d5ceaadf4882 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:00.029787 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d2d4285e-6df0-468a-a71f-d5ceaadf4882 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:00.030242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d2d4285e-6df0-468a-a71f-d5ceaadf4882 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:00.030664 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d2d4285e-6df0-468a-a71f-d5ceaadf4882 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:00.190984 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d2d4285e-6df0-468a-a71f-d5ceaadf4882 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:00.202508 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d2d4285e-6df0-468a-a71f-d5ceaadf4882 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d" status: 200 len: 1362 microversion: 2.1 time: 0.186561 Sep 14 01:13:00.215578 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 434/864] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:00 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:00.427194 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-23412240-59bc-474d-a266-fde5ca1ed809 req-3ea031ce-065a-487c-a6c2-8d9dd24091c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0febaeca-9ac9-4094-b48f-06bca1b3903d", "tag": "b7686f66-d521-48db-85c3-432d09864c2f"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:13:00.442219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-23412240-59bc-474d-a266-fde5ca1ed809 req-3ea031ce-065a-487c-a6c2-8d9dd24091c3 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:00.443000 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-23412240-59bc-474d-a266-fde5ca1ed809 req-3ea031ce-065a-487c-a6c2-8d9dd24091c3 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:00.443825 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-23412240-59bc-474d-a266-fde5ca1ed809 req-3ea031ce-065a-487c-a6c2-8d9dd24091c3 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:00.459747 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-23412240-59bc-474d-a266-fde5ca1ed809 req-3ea031ce-065a-487c-a6c2-8d9dd24091c3 service nova] Creating event network-changed:b7686f66-d521-48db-85c3-432d09864c2f for instance 0febaeca-9ac9-4094-b48f-06bca1b3903d on hv-cinder-85752 Sep 14 01:13:00.465870 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-23412240-59bc-474d-a266-fde5ca1ed809 req-3ea031ce-065a-487c-a6c2-8d9dd24091c3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042581 Sep 14 01:13:00.467921 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 431/865] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:13:01.227719 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-603d0923-5aa8-41ad-bb54-a1a145937f95 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:01.228326 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-603d0923-5aa8-41ad-bb54-a1a145937f95 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:01.234581 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-603d0923-5aa8-41ad-bb54-a1a145937f95 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:01.235057 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-603d0923-5aa8-41ad-bb54-a1a145937f95 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:01.236593 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-603d0923-5aa8-41ad-bb54-a1a145937f95 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:01.237337 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-603d0923-5aa8-41ad-bb54-a1a145937f95 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:01.237812 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-603d0923-5aa8-41ad-bb54-a1a145937f95 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:01.238249 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-603d0923-5aa8-41ad-bb54-a1a145937f95 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:01.636450 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-603d0923-5aa8-41ad-bb54-a1a145937f95 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:01.644832 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-603d0923-5aa8-41ad-bb54-a1a145937f95 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d" status: 200 len: 1362 microversion: 2.1 time: 0.421812 Sep 14 01:13:01.645481 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 435/866] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:01 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d => generated 1362 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:02.668252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-838817ba-9bf7-45a9-a082-229ad692853a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:02.668971 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-838817ba-9bf7-45a9-a082-229ad692853a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:02.675383 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-838817ba-9bf7-45a9-a082-229ad692853a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:02.675890 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-838817ba-9bf7-45a9-a082-229ad692853a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:02.676332 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-838817ba-9bf7-45a9-a082-229ad692853a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:02.677037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-838817ba-9bf7-45a9-a082-229ad692853a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:02.677502 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-838817ba-9bf7-45a9-a082-229ad692853a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:02.677927 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-838817ba-9bf7-45a9-a082-229ad692853a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:02.810851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-838817ba-9bf7-45a9-a082-229ad692853a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:02.818501 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-838817ba-9bf7-45a9-a082-229ad692853a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d" status: 200 len: 1362 microversion: 2.1 time: 0.154913 Sep 14 01:13:02.819058 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 432/867] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:02 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:03.841261 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e4dc9d2f-542e-4e8a-b973-a4bee52f8d64 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:03.841839 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e4dc9d2f-542e-4e8a-b973-a4bee52f8d64 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:03.848201 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e4dc9d2f-542e-4e8a-b973-a4bee52f8d64 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:03.848680 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e4dc9d2f-542e-4e8a-b973-a4bee52f8d64 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:03.849112 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e4dc9d2f-542e-4e8a-b973-a4bee52f8d64 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:03.849796 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e4dc9d2f-542e-4e8a-b973-a4bee52f8d64 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:03.850251 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e4dc9d2f-542e-4e8a-b973-a4bee52f8d64 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:03.850674 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e4dc9d2f-542e-4e8a-b973-a4bee52f8d64 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:03.976703 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e4dc9d2f-542e-4e8a-b973-a4bee52f8d64 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:03.984213 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e4dc9d2f-542e-4e8a-b973-a4bee52f8d64 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d" status: 200 len: 1362 microversion: 2.1 time: 0.147070 Sep 14 01:13:03.984774 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 436/868] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:03 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:05.006997 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e7f12693-8b69-45b1-92c7-261de2a57e5c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:05.007548 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-e7f12693-8b69-45b1-92c7-261de2a57e5c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:05.014257 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e7f12693-8b69-45b1-92c7-261de2a57e5c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:05.014746 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e7f12693-8b69-45b1-92c7-261de2a57e5c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:05.015180 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e7f12693-8b69-45b1-92c7-261de2a57e5c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:05.015909 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e7f12693-8b69-45b1-92c7-261de2a57e5c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:05.016367 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e7f12693-8b69-45b1-92c7-261de2a57e5c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:05.016797 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e7f12693-8b69-45b1-92c7-261de2a57e5c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:05.155240 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e7f12693-8b69-45b1-92c7-261de2a57e5c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:05.163542 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-e7f12693-8b69-45b1-92c7-261de2a57e5c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d" status: 200 len: 1362 microversion: 2.1 time: 0.160514 Sep 14 01:13:05.164115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 433/869] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:05 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:06.186269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6daa5044-17e3-49bb-bac9-e55430379dba tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:06.186877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6daa5044-17e3-49bb-bac9-e55430379dba tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:06.193398 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6daa5044-17e3-49bb-bac9-e55430379dba tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:06.193873 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6daa5044-17e3-49bb-bac9-e55430379dba tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:06.194300 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6daa5044-17e3-49bb-bac9-e55430379dba tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:06.194981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6daa5044-17e3-49bb-bac9-e55430379dba tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:06.195427 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6daa5044-17e3-49bb-bac9-e55430379dba tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:06.195868 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6daa5044-17e3-49bb-bac9-e55430379dba tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:06.326625 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6daa5044-17e3-49bb-bac9-e55430379dba tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:06.334864 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6daa5044-17e3-49bb-bac9-e55430379dba tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d" status: 200 len: 1362 microversion: 2.1 time: 0.152452 Sep 14 01:13:06.335423 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 437/870] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:06 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:06.750165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-264cd0cc-7129-4620-a5ad-251569db0b27 req-8adbe451-c26c-4220-8b0b-5fe1cb6dcc7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0febaeca-9ac9-4094-b48f-06bca1b3903d", "name": "network-vif-plugged", "status": "completed", "tag": "b7686f66-d521-48db-85c3-432d09864c2f"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:13:06.762545 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-264cd0cc-7129-4620-a5ad-251569db0b27 req-8adbe451-c26c-4220-8b0b-5fe1cb6dcc7d service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:06.763051 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-264cd0cc-7129-4620-a5ad-251569db0b27 req-8adbe451-c26c-4220-8b0b-5fe1cb6dcc7d service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:06.763476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-264cd0cc-7129-4620-a5ad-251569db0b27 req-8adbe451-c26c-4220-8b0b-5fe1cb6dcc7d service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:06.775240 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-264cd0cc-7129-4620-a5ad-251569db0b27 req-8adbe451-c26c-4220-8b0b-5fe1cb6dcc7d service nova] Creating event network-vif-plugged:b7686f66-d521-48db-85c3-432d09864c2f for instance 0febaeca-9ac9-4094-b48f-06bca1b3903d on hv-cinder-85752 Sep 14 01:13:06.779984 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-264cd0cc-7129-4620-a5ad-251569db0b27 req-8adbe451-c26c-4220-8b0b-5fe1cb6dcc7d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033544 Sep 14 01:13:06.780887 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 434/871] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:13:07.358162 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2f5e5bd2-d702-4aa7-b9a5-c31168bd915e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:07.358864 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2f5e5bd2-d702-4aa7-b9a5-c31168bd915e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:07.365304 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f5e5bd2-d702-4aa7-b9a5-c31168bd915e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:07.365781 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f5e5bd2-d702-4aa7-b9a5-c31168bd915e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:07.366218 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f5e5bd2-d702-4aa7-b9a5-c31168bd915e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:07.366898 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f5e5bd2-d702-4aa7-b9a5-c31168bd915e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:07.367349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f5e5bd2-d702-4aa7-b9a5-c31168bd915e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:07.367812 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f5e5bd2-d702-4aa7-b9a5-c31168bd915e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:07.495918 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2f5e5bd2-d702-4aa7-b9a5-c31168bd915e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:07.504149 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2f5e5bd2-d702-4aa7-b9a5-c31168bd915e tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d" status: 200 len: 1362 microversion: 2.1 time: 0.150071 Sep 14 01:13:07.504705 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 438/872] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:07 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:08.525529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=2 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:13:08.526306 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=6 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:13:08.531395 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a4c822a8-5bac-4aca-8027-e1d0bddacde5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:08.532143 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a4c822a8-5bac-4aca-8027-e1d0bddacde5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:08.539154 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a4c822a8-5bac-4aca-8027-e1d0bddacde5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:08.539809 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a4c822a8-5bac-4aca-8027-e1d0bddacde5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:08.540252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a4c822a8-5bac-4aca-8027-e1d0bddacde5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:08.540947 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a4c822a8-5bac-4aca-8027-e1d0bddacde5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:08.541406 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a4c822a8-5bac-4aca-8027-e1d0bddacde5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:08.541832 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a4c822a8-5bac-4aca-8027-e1d0bddacde5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:08.684520 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a4c822a8-5bac-4aca-8027-e1d0bddacde5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:08.692822 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a4c822a8-5bac-4aca-8027-e1d0bddacde5 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d" status: 200 len: 1362 microversion: 2.1 time: 0.168200 Sep 14 01:13:08.693415 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 435/873] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:08 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:09.717126 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e67e5f6a-7cc6-4c50-b06e-4453bab40a6a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:09.717961 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e67e5f6a-7cc6-4c50-b06e-4453bab40a6a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:09.720282 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=6 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:13:09.726029 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e67e5f6a-7cc6-4c50-b06e-4453bab40a6a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:09.726568 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e67e5f6a-7cc6-4c50-b06e-4453bab40a6a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:09.726953 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e67e5f6a-7cc6-4c50-b06e-4453bab40a6a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:09.727683 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e67e5f6a-7cc6-4c50-b06e-4453bab40a6a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:09.728295 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e67e5f6a-7cc6-4c50-b06e-4453bab40a6a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:09.728726 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e67e5f6a-7cc6-4c50-b06e-4453bab40a6a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:09.866867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e67e5f6a-7cc6-4c50-b06e-4453bab40a6a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:09.875004 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e67e5f6a-7cc6-4c50-b06e-4453bab40a6a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d" status: 200 len: 1547 microversion: 2.1 time: 0.161747 Sep 14 01:13:09.876221 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 439/874] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:09 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:09.900692 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-5c09eccd-98c4-472a-be3f-b6ee6101e4d6 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:09.901247 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-5c09eccd-98c4-472a-be3f-b6ee6101e4d6 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:09.904097 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:13:09.911188 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5c09eccd-98c4-472a-be3f-b6ee6101e4d6 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:09.911804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5c09eccd-98c4-472a-be3f-b6ee6101e4d6 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:09.912330 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5c09eccd-98c4-472a-be3f-b6ee6101e4d6 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:09.913089 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5c09eccd-98c4-472a-be3f-b6ee6101e4d6 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:09.913614 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5c09eccd-98c4-472a-be3f-b6ee6101e4d6 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:09.914099 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5c09eccd-98c4-472a-be3f-b6ee6101e4d6 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:09.994661 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-5c09eccd-98c4-472a-be3f-b6ee6101e4d6 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098222 Sep 14 01:13:09.995322 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 436/875] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Sep 14 01:13:09 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:13:11.201602 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-c2ead007-f33d-4827-a997-e884a5231377 req-dbd74fcd-8d55-4b91-94f6-70c12bbe5668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0febaeca-9ac9-4094-b48f-06bca1b3903d", "tag": "b7686f66-d521-48db-85c3-432d09864c2f"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:13:11.212270 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-c2ead007-f33d-4827-a997-e884a5231377 req-dbd74fcd-8d55-4b91-94f6-70c12bbe5668 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:11.212934 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-c2ead007-f33d-4827-a997-e884a5231377 req-dbd74fcd-8d55-4b91-94f6-70c12bbe5668 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:11.213572 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-c2ead007-f33d-4827-a997-e884a5231377 req-dbd74fcd-8d55-4b91-94f6-70c12bbe5668 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:11.226258 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-c2ead007-f33d-4827-a997-e884a5231377 req-dbd74fcd-8d55-4b91-94f6-70c12bbe5668 service nova] Creating event network-changed:b7686f66-d521-48db-85c3-432d09864c2f for instance 0febaeca-9ac9-4094-b48f-06bca1b3903d on hv-cinder-85752 Sep 14 01:13:11.231398 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-c2ead007-f33d-4827-a997-e884a5231377 req-dbd74fcd-8d55-4b91-94f6-70c12bbe5668 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033303 Sep 14 01:13:11.232178 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 440/876] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:13:36.156649 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e939c4d8-1d83-4847-bbae-1e9bc743c32b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:36.157231 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-e939c4d8-1d83-4847-bbae-1e9bc743c32b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:36.163010 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=31 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:13:36.164087 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:13:36.166155 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e939c4d8-1d83-4847-bbae-1e9bc743c32b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:36.166679 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e939c4d8-1d83-4847-bbae-1e9bc743c32b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:36.167115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e939c4d8-1d83-4847-bbae-1e9bc743c32b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:36.167870 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e939c4d8-1d83-4847-bbae-1e9bc743c32b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:36.168328 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e939c4d8-1d83-4847-bbae-1e9bc743c32b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:36.168751 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e939c4d8-1d83-4847-bbae-1e9bc743c32b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:36.199476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-e939c4d8-1d83-4847-bbae-1e9bc743c32b tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9/ips" status: 200 len: 150 microversion: 2.1 time: 0.047430 Sep 14 01:13:36.200438 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 437/877] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Sep 14 01:13:36 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:13:37.407059 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:13:37.407980 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:13:37.412221 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-40ed2da0-dfe1-4c2b-9afa-0513a64f5431 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Action: 'create', calling method: .version_select at 0x7f5043c64550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-537043076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8mfp7f5Jj86EkvF+bAcRXDKVbwATZa/bleSBFyIjV6Ok2lvALm7R/cnV2fnGSjCtrOp+c4XsqRW1UFyR9ztZAU441mHec8NUtRg9QCDTeCOiZzMkEGdyltt+aEtbaX9A=="}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:13:37.433757 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-40ed2da0-dfe1-4c2b-9afa-0513a64f5431 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Getting quotas for project f93905695d7a4f8495534c38a7bebfa4. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:13:37.438283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-40ed2da0-dfe1-4c2b-9afa-0513a64f5431 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Getting quotas for user f8d750f711d34f80816f124cb3d1f4b4 and project f93905695d7a4f8495534c38a7bebfa4. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:13:37.463936 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-40ed2da0-dfe1-4c2b-9afa-0513a64f5431 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.059000 Sep 14 01:13:37.465021 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 441/878] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Sep 14 01:13:37 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:13:37.521289 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-5f921174-47d4-4077-90d6-63ca16305c37 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1341783535", "imageRef": "515f3fef-f1fa-4a00-aec7-282b6493766a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-537043076", "networks": [{"uuid": "d4b96baa-eabb-4692-b8fa-06df3d181968"}]}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:13:37.580953 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.network.neutron [None req-5f921174-47d4-4077-90d6-63ca16305c37 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] validate_networks() for [('d4b96baa-eabb-4692-b8fa-06df3d181968', None, None, None, None, None)] {{(pid=120620) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:13:37.592730 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-06079c2f-0109-47b0-bd9e-6d7995410867 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15920cb3-7dec-40f3-b2e6-080c1d579168"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:13:37.598232 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-06079c2f-0109-47b0-bd9e-6d7995410867 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:37.605083 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-06079c2f-0109-47b0-bd9e-6d7995410867 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:37.605570 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-06079c2f-0109-47b0-bd9e-6d7995410867 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:37.606006 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-06079c2f-0109-47b0-bd9e-6d7995410867 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:37.606704 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-06079c2f-0109-47b0-bd9e-6d7995410867 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:37.607164 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-06079c2f-0109-47b0-bd9e-6d7995410867 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:37.608582 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-06079c2f-0109-47b0-bd9e-6d7995410867 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:37.900534 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-06079c2f-0109-47b0-bd9e-6d7995410867 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "POST /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311725 Sep 14 01:13:37.901187 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 442/879] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 01:13:37 2022] POST /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:13:38.019602 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-5f921174-47d4-4077-90d6-63ca16305c37 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Flavor limits 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:13:38.020029 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-5f921174-47d4-4077-90d6-63ca16305c37 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Image limits 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:13:38.020511 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-5f921174-47d4-4077-90d6-63ca16305c37 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Flavor pref 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:13:38.020922 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-5f921174-47d4-4077-90d6-63ca16305c37 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Image pref 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:13:38.021336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-5f921174-47d4-4077-90d6-63ca16305c37 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:13:38.031472 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5f921174-47d4-4077-90d6-63ca16305c37 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:38.032091 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5f921174-47d4-4077-90d6-63ca16305c37 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:38.032534 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5f921174-47d4-4077-90d6-63ca16305c37 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:38.033344 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5f921174-47d4-4077-90d6-63ca16305c37 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:38.033802 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5f921174-47d4-4077-90d6-63ca16305c37 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:38.034228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5f921174-47d4-4077-90d6-63ca16305c37 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:38.052072 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-5f921174-47d4-4077-90d6-63ca16305c37 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Getting quotas for project f93905695d7a4f8495534c38a7bebfa4. Resources: {'cores', 'instances', 'ram'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:13:38.056031 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-5f921174-47d4-4077-90d6-63ca16305c37 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Getting quotas for user f8d750f711d34f80816f124cb3d1f4b4 and project f93905695d7a4f8495534c38a7bebfa4. Resources: {'cores', 'instances', 'ram'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:13:38.067745 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-5f921174-47d4-4077-90d6-63ca16305c37 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Going to run 1 instances... {{(pid=120620) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:13:38.069974 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-5f921174-47d4-4077-90d6-63ca16305c37 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='515f3fef-f1fa-4a00-aec7-282b6493766a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120620) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:13:38.118979 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-5f921174-47d4-4077-90d6-63ca16305c37 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602703 Sep 14 01:13:38.123732 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 438/880] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 01:13:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 01:13:38.138443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-850d1733-607d-4f3e-ab3f-a1e0fa769517 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:38.139272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-850d1733-607d-4f3e-ab3f-a1e0fa769517 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:38.193451 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-850d1733-607d-4f3e-ab3f-a1e0fa769517 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:38.200208 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-850d1733-607d-4f3e-ab3f-a1e0fa769517 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1258 microversion: 2.1 time: 0.068101 Sep 14 01:13:38.201525 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 443/881] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:38 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:13:39.223423 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7eb8b5aa-c2df-4d40-9380-a623be12fde9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:39.224192 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7eb8b5aa-c2df-4d40-9380-a623be12fde9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:39.231446 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7eb8b5aa-c2df-4d40-9380-a623be12fde9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:39.232026 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7eb8b5aa-c2df-4d40-9380-a623be12fde9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:39.232458 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7eb8b5aa-c2df-4d40-9380-a623be12fde9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:39.233142 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7eb8b5aa-c2df-4d40-9380-a623be12fde9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:39.233597 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7eb8b5aa-c2df-4d40-9380-a623be12fde9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:39.234045 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7eb8b5aa-c2df-4d40-9380-a623be12fde9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:39.295166 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7eb8b5aa-c2df-4d40-9380-a623be12fde9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:39.304251 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7eb8b5aa-c2df-4d40-9380-a623be12fde9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1310 microversion: 2.1 time: 0.085257 Sep 14 01:13:39.305034 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 439/882] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:39 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:40.328241 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8f403b08-d03a-4e4e-8bf0-4249968b312b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:40.329116 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8f403b08-d03a-4e4e-8bf0-4249968b312b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:40.339162 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8f403b08-d03a-4e4e-8bf0-4249968b312b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:40.339678 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8f403b08-d03a-4e4e-8bf0-4249968b312b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:40.340118 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8f403b08-d03a-4e4e-8bf0-4249968b312b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:40.340820 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8f403b08-d03a-4e4e-8bf0-4249968b312b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:40.341270 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8f403b08-d03a-4e4e-8bf0-4249968b312b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:40.342617 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8f403b08-d03a-4e4e-8bf0-4249968b312b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:40.568643 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8f403b08-d03a-4e4e-8bf0-4249968b312b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:40.576687 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8f403b08-d03a-4e4e-8bf0-4249968b312b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1358 microversion: 2.1 time: 0.252250 Sep 14 01:13:40.577281 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 444/883] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:40 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:41.600708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-b316943c-3a2a-452c-9738-32059ac34425 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:41.601318 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-b316943c-3a2a-452c-9738-32059ac34425 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:41.607885 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b316943c-3a2a-452c-9738-32059ac34425 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:41.608593 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b316943c-3a2a-452c-9738-32059ac34425 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:41.609023 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b316943c-3a2a-452c-9738-32059ac34425 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:41.609860 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b316943c-3a2a-452c-9738-32059ac34425 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:41.610627 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b316943c-3a2a-452c-9738-32059ac34425 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:41.611095 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b316943c-3a2a-452c-9738-32059ac34425 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:41.751509 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b316943c-3a2a-452c-9738-32059ac34425 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:41.761154 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-b316943c-3a2a-452c-9738-32059ac34425 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1358 microversion: 2.1 time: 0.164330 Sep 14 01:13:41.761988 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 440/884] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:41 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:42.786433 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-81474a48-0c82-47e6-a141-b0f5c6d545a8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:42.787052 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-81474a48-0c82-47e6-a141-b0f5c6d545a8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:42.793513 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81474a48-0c82-47e6-a141-b0f5c6d545a8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:42.794070 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81474a48-0c82-47e6-a141-b0f5c6d545a8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:42.794562 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81474a48-0c82-47e6-a141-b0f5c6d545a8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:42.795259 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81474a48-0c82-47e6-a141-b0f5c6d545a8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:42.795734 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81474a48-0c82-47e6-a141-b0f5c6d545a8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:42.796156 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-81474a48-0c82-47e6-a141-b0f5c6d545a8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:42.951874 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-81474a48-0c82-47e6-a141-b0f5c6d545a8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:42.960880 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-81474a48-0c82-47e6-a141-b0f5c6d545a8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1358 microversion: 2.1 time: 0.179579 Sep 14 01:13:42.961774 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 445/885] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:42 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:43.984449 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a536dfbe-45ab-498e-8e1e-d1506e2aa1a7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:43.985163 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a536dfbe-45ab-498e-8e1e-d1506e2aa1a7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:43.991983 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a536dfbe-45ab-498e-8e1e-d1506e2aa1a7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:43.992556 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a536dfbe-45ab-498e-8e1e-d1506e2aa1a7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:43.993090 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a536dfbe-45ab-498e-8e1e-d1506e2aa1a7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:43.993869 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a536dfbe-45ab-498e-8e1e-d1506e2aa1a7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:43.994405 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a536dfbe-45ab-498e-8e1e-d1506e2aa1a7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:43.994900 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a536dfbe-45ab-498e-8e1e-d1506e2aa1a7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:44.131900 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a536dfbe-45ab-498e-8e1e-d1506e2aa1a7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:44.142440 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a536dfbe-45ab-498e-8e1e-d1506e2aa1a7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1358 microversion: 2.1 time: 0.161717 Sep 14 01:13:44.142942 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 441/886] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:43 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:45.166192 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6feb54fc-b5d8-48b5-9ff1-f974f83947b9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:45.166930 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6feb54fc-b5d8-48b5-9ff1-f974f83947b9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:45.173213 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6feb54fc-b5d8-48b5-9ff1-f974f83947b9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:45.173693 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6feb54fc-b5d8-48b5-9ff1-f974f83947b9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:45.174131 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6feb54fc-b5d8-48b5-9ff1-f974f83947b9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:45.183643 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6feb54fc-b5d8-48b5-9ff1-f974f83947b9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:45.184189 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6feb54fc-b5d8-48b5-9ff1-f974f83947b9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:45.184584 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6feb54fc-b5d8-48b5-9ff1-f974f83947b9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:45.320871 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6feb54fc-b5d8-48b5-9ff1-f974f83947b9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:45.329950 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6feb54fc-b5d8-48b5-9ff1-f974f83947b9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1358 microversion: 2.1 time: 0.167575 Sep 14 01:13:45.330781 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 446/887] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:45 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:45.959454 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6470d02c-c862-41f8-98b1-3488a48d153a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:45.960171 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-6470d02c-c862-41f8-98b1-3488a48d153a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:45.966381 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6470d02c-c862-41f8-98b1-3488a48d153a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:45.966868 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6470d02c-c862-41f8-98b1-3488a48d153a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:45.967307 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6470d02c-c862-41f8-98b1-3488a48d153a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:45.968035 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6470d02c-c862-41f8-98b1-3488a48d153a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:45.968495 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6470d02c-c862-41f8-98b1-3488a48d153a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:45.968926 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6470d02c-c862-41f8-98b1-3488a48d153a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:45.995092 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-6470d02c-c862-41f8-98b1-3488a48d153a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611/ips" status: 200 len: 152 microversion: 2.20 time: 0.039671 Sep 14 01:13:45.999855 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 442/888] 10.222.0.42 () {60 vars in 1289 bytes} [Wed Sep 14 01:13:45 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 01:13:46.355277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c11ba31b-9d98-4ac1-8363-b6bf02ede579 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:46.355968 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c11ba31b-9d98-4ac1-8363-b6bf02ede579 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:46.362835 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c11ba31b-9d98-4ac1-8363-b6bf02ede579 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:46.363763 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c11ba31b-9d98-4ac1-8363-b6bf02ede579 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:46.364329 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c11ba31b-9d98-4ac1-8363-b6bf02ede579 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:46.365232 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c11ba31b-9d98-4ac1-8363-b6bf02ede579 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:46.365841 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c11ba31b-9d98-4ac1-8363-b6bf02ede579 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:46.366462 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c11ba31b-9d98-4ac1-8363-b6bf02ede579 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:46.512829 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c11ba31b-9d98-4ac1-8363-b6bf02ede579 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:46.521753 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c11ba31b-9d98-4ac1-8363-b6bf02ede579 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1358 microversion: 2.1 time: 0.170377 Sep 14 01:13:46.522371 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 447/889] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:46 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:47.544660 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-3f15febf-2a48-4086-a404-4db8104c2314 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:47.545543 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-3f15febf-2a48-4086-a404-4db8104c2314 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:47.553143 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3f15febf-2a48-4086-a404-4db8104c2314 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:47.553913 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3f15febf-2a48-4086-a404-4db8104c2314 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:47.554611 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3f15febf-2a48-4086-a404-4db8104c2314 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:47.555418 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3f15febf-2a48-4086-a404-4db8104c2314 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:47.555976 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3f15febf-2a48-4086-a404-4db8104c2314 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:47.556470 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3f15febf-2a48-4086-a404-4db8104c2314 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:47.698502 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-3f15febf-2a48-4086-a404-4db8104c2314 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:47.706099 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-3f15febf-2a48-4086-a404-4db8104c2314 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1358 microversion: 2.1 time: 0.165297 Sep 14 01:13:47.707451 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 443/890] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:47 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:48.159004 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c4da8d8b-8b44-432f-9bad-2db745ca15ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:13:48.159643 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c4da8d8b-8b44-432f-9bad-2db745ca15ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:48.167069 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c4da8d8b-8b44-432f-9bad-2db745ca15ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:48.167571 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c4da8d8b-8b44-432f-9bad-2db745ca15ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:48.168036 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c4da8d8b-8b44-432f-9bad-2db745ca15ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:48.168714 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c4da8d8b-8b44-432f-9bad-2db745ca15ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:48.169168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c4da8d8b-8b44-432f-9bad-2db745ca15ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:48.169596 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c4da8d8b-8b44-432f-9bad-2db745ca15ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:48.195929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-c4da8d8b-8b44-432f-9bad-2db745ca15ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lazy-loading 'flavor' on Instance uuid 291f27aa-9e42-4937-be7d-5e849d90e611 {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:13:48.198565 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=6 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:13:48.401151 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c4da8d8b-8b44-432f-9bad-2db745ca15ab tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "POST /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611/action" status: 202 len: 0 microversion: 2.20 time: 0.245960 Sep 14 01:13:48.401784 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 448/891] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Sep 14 01:13:48 2022] POST /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 01:13:48.410163 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d99e291a-53e8-41a8-81bb-b28e2a31792e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:48.410809 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d99e291a-53e8-41a8-81bb-b28e2a31792e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:48.416272 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=2 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:13:48.417087 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=6 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:13:48.418676 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d99e291a-53e8-41a8-81bb-b28e2a31792e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:48.419219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d99e291a-53e8-41a8-81bb-b28e2a31792e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:48.419627 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d99e291a-53e8-41a8-81bb-b28e2a31792e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:48.420377 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d99e291a-53e8-41a8-81bb-b28e2a31792e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:48.420833 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d99e291a-53e8-41a8-81bb-b28e2a31792e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:48.421257 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d99e291a-53e8-41a8-81bb-b28e2a31792e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:48.564279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d99e291a-53e8-41a8-81bb-b28e2a31792e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:48.573236 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d99e291a-53e8-41a8-81bb-b28e2a31792e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:48.574693 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d99e291a-53e8-41a8-81bb-b28e2a31792e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:48.575891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d99e291a-53e8-41a8-81bb-b28e2a31792e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.169844 Sep 14 01:13:48.576449 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 444/892] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:13:48 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:13:48.730121 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c9dfe236-45a6-4dd5-9e81-d5deda9022d1 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:48.730809 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c9dfe236-45a6-4dd5-9e81-d5deda9022d1 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:48.737225 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c9dfe236-45a6-4dd5-9e81-d5deda9022d1 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:48.737708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c9dfe236-45a6-4dd5-9e81-d5deda9022d1 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:48.738698 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c9dfe236-45a6-4dd5-9e81-d5deda9022d1 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:48.739378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c9dfe236-45a6-4dd5-9e81-d5deda9022d1 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:48.739855 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c9dfe236-45a6-4dd5-9e81-d5deda9022d1 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:48.740272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c9dfe236-45a6-4dd5-9e81-d5deda9022d1 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:48.880578 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c9dfe236-45a6-4dd5-9e81-d5deda9022d1 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:48.888999 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c9dfe236-45a6-4dd5-9e81-d5deda9022d1 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1358 microversion: 2.1 time: 0.163145 Sep 14 01:13:48.889792 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 449/893] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:48 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:13:49.602706 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8f6bca84-ad54-46a6-a67f-cb6c2e9fb67a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:49.604077 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8f6bca84-ad54-46a6-a67f-cb6c2e9fb67a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:49.612359 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8f6bca84-ad54-46a6-a67f-cb6c2e9fb67a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:49.613786 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8f6bca84-ad54-46a6-a67f-cb6c2e9fb67a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:49.614571 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8f6bca84-ad54-46a6-a67f-cb6c2e9fb67a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:49.615355 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8f6bca84-ad54-46a6-a67f-cb6c2e9fb67a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:49.615911 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8f6bca84-ad54-46a6-a67f-cb6c2e9fb67a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:49.616557 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8f6bca84-ad54-46a6-a67f-cb6c2e9fb67a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:49.773020 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8f6bca84-ad54-46a6-a67f-cb6c2e9fb67a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:49.782305 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8f6bca84-ad54-46a6-a67f-cb6c2e9fb67a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:49.783822 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8f6bca84-ad54-46a6-a67f-cb6c2e9fb67a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:49.785534 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8f6bca84-ad54-46a6-a67f-cb6c2e9fb67a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.186907 Sep 14 01:13:49.786274 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 445/894] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:13:49 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:13:49.913762 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b0925c2d-ba0f-4ecd-b3a6-36e6591e8b5a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:49.914404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b0925c2d-ba0f-4ecd-b3a6-36e6591e8b5a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:49.921044 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b0925c2d-ba0f-4ecd-b3a6-36e6591e8b5a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:49.921523 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b0925c2d-ba0f-4ecd-b3a6-36e6591e8b5a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:49.921954 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b0925c2d-ba0f-4ecd-b3a6-36e6591e8b5a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:49.922643 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b0925c2d-ba0f-4ecd-b3a6-36e6591e8b5a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:49.923097 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b0925c2d-ba0f-4ecd-b3a6-36e6591e8b5a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:49.923517 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b0925c2d-ba0f-4ecd-b3a6-36e6591e8b5a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:50.060453 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b0925c2d-ba0f-4ecd-b3a6-36e6591e8b5a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:50.068302 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b0925c2d-ba0f-4ecd-b3a6-36e6591e8b5a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1358 microversion: 2.1 time: 0.159857 Sep 14 01:13:50.068867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 450/895] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:49 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:50.810965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-629fa1b1-b96f-416f-82f1-0725ec932af3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:50.811594 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-629fa1b1-b96f-416f-82f1-0725ec932af3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:50.818582 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-629fa1b1-b96f-416f-82f1-0725ec932af3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:50.819071 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-629fa1b1-b96f-416f-82f1-0725ec932af3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:50.819522 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-629fa1b1-b96f-416f-82f1-0725ec932af3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:50.820222 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-629fa1b1-b96f-416f-82f1-0725ec932af3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:50.820678 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-629fa1b1-b96f-416f-82f1-0725ec932af3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:50.821104 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-629fa1b1-b96f-416f-82f1-0725ec932af3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:50.957473 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-629fa1b1-b96f-416f-82f1-0725ec932af3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:50.965734 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-629fa1b1-b96f-416f-82f1-0725ec932af3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:50.967190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-629fa1b1-b96f-416f-82f1-0725ec932af3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:50.968490 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-629fa1b1-b96f-416f-82f1-0725ec932af3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.161366 Sep 14 01:13:50.969055 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 446/896] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:13:50 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:13:51.091347 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-35e16dd6-3bb9-4579-a1cd-835e9080130b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:51.091910 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-35e16dd6-3bb9-4579-a1cd-835e9080130b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:51.098481 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-35e16dd6-3bb9-4579-a1cd-835e9080130b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:51.099004 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-35e16dd6-3bb9-4579-a1cd-835e9080130b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:51.099436 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-35e16dd6-3bb9-4579-a1cd-835e9080130b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:51.100149 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-35e16dd6-3bb9-4579-a1cd-835e9080130b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:51.100631 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-35e16dd6-3bb9-4579-a1cd-835e9080130b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:51.101051 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-35e16dd6-3bb9-4579-a1cd-835e9080130b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:51.229298 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-35e16dd6-3bb9-4579-a1cd-835e9080130b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:51.236952 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-35e16dd6-3bb9-4579-a1cd-835e9080130b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1358 microversion: 2.1 time: 0.149481 Sep 14 01:13:51.237514 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 451/897] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:51 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:51.994143 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-c5309c63-2617-42b1-b835-b717b2d3f4db tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:51.994753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-c5309c63-2617-42b1-b835-b717b2d3f4db tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:52.001435 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c5309c63-2617-42b1-b835-b717b2d3f4db tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:52.001920 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c5309c63-2617-42b1-b835-b717b2d3f4db tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:52.002359 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c5309c63-2617-42b1-b835-b717b2d3f4db tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:52.003053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c5309c63-2617-42b1-b835-b717b2d3f4db tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:52.003614 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c5309c63-2617-42b1-b835-b717b2d3f4db tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:52.004046 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c5309c63-2617-42b1-b835-b717b2d3f4db tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:52.131697 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c5309c63-2617-42b1-b835-b717b2d3f4db tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:52.140022 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c5309c63-2617-42b1-b835-b717b2d3f4db tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:52.141458 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c5309c63-2617-42b1-b835-b717b2d3f4db tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:52.142595 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-c5309c63-2617-42b1-b835-b717b2d3f4db tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.152550 Sep 14 01:13:52.143144 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 447/898] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:13:51 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:13:52.261036 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b1d6b599-ea76-45ff-9dfb-b003e4964f8b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:52.261644 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b1d6b599-ea76-45ff-9dfb-b003e4964f8b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:52.267989 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b1d6b599-ea76-45ff-9dfb-b003e4964f8b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:52.268469 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b1d6b599-ea76-45ff-9dfb-b003e4964f8b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:52.268900 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b1d6b599-ea76-45ff-9dfb-b003e4964f8b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:52.269581 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b1d6b599-ea76-45ff-9dfb-b003e4964f8b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:52.270031 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b1d6b599-ea76-45ff-9dfb-b003e4964f8b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:52.270454 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b1d6b599-ea76-45ff-9dfb-b003e4964f8b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:52.396655 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b1d6b599-ea76-45ff-9dfb-b003e4964f8b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:52.404249 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b1d6b599-ea76-45ff-9dfb-b003e4964f8b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1358 microversion: 2.1 time: 0.147322 Sep 14 01:13:52.404814 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 452/899] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:52 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:53.169212 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-5a944169-6bb9-4995-965c-beb0a90c59ac tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:53.169852 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-5a944169-6bb9-4995-965c-beb0a90c59ac tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:53.176224 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5a944169-6bb9-4995-965c-beb0a90c59ac tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:53.176709 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5a944169-6bb9-4995-965c-beb0a90c59ac tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:53.177146 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5a944169-6bb9-4995-965c-beb0a90c59ac tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:53.177840 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5a944169-6bb9-4995-965c-beb0a90c59ac tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:53.178293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5a944169-6bb9-4995-965c-beb0a90c59ac tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:53.178709 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-5a944169-6bb9-4995-965c-beb0a90c59ac tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:53.313072 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-5a944169-6bb9-4995-965c-beb0a90c59ac tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:53.321094 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-5a944169-6bb9-4995-965c-beb0a90c59ac tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:53.322527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-5a944169-6bb9-4995-965c-beb0a90c59ac tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:53.323702 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-5a944169-6bb9-4995-965c-beb0a90c59ac tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.158414 Sep 14 01:13:53.324254 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 448/900] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:13:53 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:13:53.427109 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-75972c64-90f2-4d81-9810-6fbeb839ed99 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:53.427747 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-75972c64-90f2-4d81-9810-6fbeb839ed99 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:53.434373 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75972c64-90f2-4d81-9810-6fbeb839ed99 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:53.434848 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75972c64-90f2-4d81-9810-6fbeb839ed99 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:53.435280 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75972c64-90f2-4d81-9810-6fbeb839ed99 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:53.435982 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75972c64-90f2-4d81-9810-6fbeb839ed99 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:53.436432 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75972c64-90f2-4d81-9810-6fbeb839ed99 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:53.436849 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-75972c64-90f2-4d81-9810-6fbeb839ed99 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:53.566639 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-75972c64-90f2-4d81-9810-6fbeb839ed99 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:53.575056 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-75972c64-90f2-4d81-9810-6fbeb839ed99 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1358 microversion: 2.1 time: 0.151890 Sep 14 01:13:53.575627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 453/901] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:53 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:13:54.350280 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9b65ae6c-7fde-45de-8271-ac2a6d9a74df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:54.351132 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9b65ae6c-7fde-45de-8271-ac2a6d9a74df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:54.358461 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9b65ae6c-7fde-45de-8271-ac2a6d9a74df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:54.359122 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9b65ae6c-7fde-45de-8271-ac2a6d9a74df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:54.359712 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9b65ae6c-7fde-45de-8271-ac2a6d9a74df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:54.360736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9b65ae6c-7fde-45de-8271-ac2a6d9a74df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:54.361236 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9b65ae6c-7fde-45de-8271-ac2a6d9a74df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:54.361740 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9b65ae6c-7fde-45de-8271-ac2a6d9a74df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:54.586855 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9b65ae6c-7fde-45de-8271-ac2a6d9a74df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:54.595089 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9b65ae6c-7fde-45de-8271-ac2a6d9a74df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:54.596571 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9b65ae6c-7fde-45de-8271-ac2a6d9a74df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:54.597735 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9b65ae6c-7fde-45de-8271-ac2a6d9a74df tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.252034 Sep 14 01:13:54.598444 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 449/902] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:13:54 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:13:54.598626 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-74cc0a07-96f4-44de-8a64-a9b4517bc84b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:54.599245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-74cc0a07-96f4-44de-8a64-a9b4517bc84b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:54.606837 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74cc0a07-96f4-44de-8a64-a9b4517bc84b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:54.607428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74cc0a07-96f4-44de-8a64-a9b4517bc84b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:54.608020 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74cc0a07-96f4-44de-8a64-a9b4517bc84b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:54.608781 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74cc0a07-96f4-44de-8a64-a9b4517bc84b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:54.609236 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74cc0a07-96f4-44de-8a64-a9b4517bc84b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:54.609664 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-74cc0a07-96f4-44de-8a64-a9b4517bc84b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:54.744928 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-74cc0a07-96f4-44de-8a64-a9b4517bc84b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:54.752444 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-74cc0a07-96f4-44de-8a64-a9b4517bc84b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1358 microversion: 2.1 time: 0.158033 Sep 14 01:13:54.753013 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 454/903] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:54 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:13:54.792270 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-9553d169-81ce-47db-bf5c-c56f73a0f907 req-1f6cb9eb-82d2-4dba-95a8-6be5f13236b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c532d078-01eb-4150-8869-3c33a457898c", "tag": "78292043-7571-4bbd-b478-4125b485b189"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:13:54.801809 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-9553d169-81ce-47db-bf5c-c56f73a0f907 req-1f6cb9eb-82d2-4dba-95a8-6be5f13236b9 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:54.802286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-9553d169-81ce-47db-bf5c-c56f73a0f907 req-1f6cb9eb-82d2-4dba-95a8-6be5f13236b9 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:54.802760 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-9553d169-81ce-47db-bf5c-c56f73a0f907 req-1f6cb9eb-82d2-4dba-95a8-6be5f13236b9 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:54.815920 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-9553d169-81ce-47db-bf5c-c56f73a0f907 req-1f6cb9eb-82d2-4dba-95a8-6be5f13236b9 service nova] Creating event network-changed:78292043-7571-4bbd-b478-4125b485b189 for instance c532d078-01eb-4150-8869-3c33a457898c on hv-cinder-85752 Sep 14 01:13:54.821019 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-9553d169-81ce-47db-bf5c-c56f73a0f907 req-1f6cb9eb-82d2-4dba-95a8-6be5f13236b9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033401 Sep 14 01:13:54.821621 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 450/904] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:13:55.624908 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8490e41d-2305-455b-9ac2-b779ab2b6cfc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:55.625524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8490e41d-2305-455b-9ac2-b779ab2b6cfc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:55.632255 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8490e41d-2305-455b-9ac2-b779ab2b6cfc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:55.632744 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8490e41d-2305-455b-9ac2-b779ab2b6cfc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:55.633177 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8490e41d-2305-455b-9ac2-b779ab2b6cfc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:55.633869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8490e41d-2305-455b-9ac2-b779ab2b6cfc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:55.634357 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8490e41d-2305-455b-9ac2-b779ab2b6cfc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:55.634779 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8490e41d-2305-455b-9ac2-b779ab2b6cfc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:55.767932 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8490e41d-2305-455b-9ac2-b779ab2b6cfc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:55.776771 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-fa05756f-c5ed-47e0-a607-e7098965ec3a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:55.777333 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8490e41d-2305-455b-9ac2-b779ab2b6cfc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:55.777552 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-fa05756f-c5ed-47e0-a607-e7098965ec3a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:55.778456 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8490e41d-2305-455b-9ac2-b779ab2b6cfc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:55.779648 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8490e41d-2305-455b-9ac2-b779ab2b6cfc tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.158794 Sep 14 01:13:55.780203 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 455/905] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:13:55 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:13:55.784296 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa05756f-c5ed-47e0-a607-e7098965ec3a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:55.784777 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa05756f-c5ed-47e0-a607-e7098965ec3a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:55.785212 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa05756f-c5ed-47e0-a607-e7098965ec3a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:55.785899 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa05756f-c5ed-47e0-a607-e7098965ec3a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:55.786352 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa05756f-c5ed-47e0-a607-e7098965ec3a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:55.786770 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa05756f-c5ed-47e0-a607-e7098965ec3a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:55.913691 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-fa05756f-c5ed-47e0-a607-e7098965ec3a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:55.921256 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-fa05756f-c5ed-47e0-a607-e7098965ec3a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1358 microversion: 2.1 time: 0.148676 Sep 14 01:13:55.921810 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 451/906] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:55 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:13:56.183602 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-60c71b71-9891-45f2-be7f-b47c4cff6476 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15920cb3-7dec-40f3-b2e6-080c1d579168"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:13:56.186009 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-60c71b71-9891-45f2-be7f-b47c4cff6476 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:56.191931 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-60c71b71-9891-45f2-be7f-b47c4cff6476 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:56.192415 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-60c71b71-9891-45f2-be7f-b47c4cff6476 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:56.192848 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-60c71b71-9891-45f2-be7f-b47c4cff6476 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:56.194165 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-60c71b71-9891-45f2-be7f-b47c4cff6476 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:56.194615 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-60c71b71-9891-45f2-be7f-b47c4cff6476 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:56.195039 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-60c71b71-9891-45f2-be7f-b47c4cff6476 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:56.198928 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:13:56.276070 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-60c71b71-9891-45f2-be7f-b47c4cff6476 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] HTTP exception thrown: Invalid volume: volume 15920cb3-7dec-40f3-b2e6-080c1d579168 is already attached to instances: 49f5ab2e-e424-49af-81ac-dc4b94c742b9 Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-60c71b71-9891-45f2-be7f-b47c4cff6476 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Request method failure captured: Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: POST /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9/os-volume_attachments HTTP/1.1 Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 74 Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISi3fXiNfssV-9suzyOi_X569sc3LzFc1vlFMuwkYOTf31lKxNzFY-VkibuUEPaC7Cvi81CQQfr4-r5n6Uvso8OzNo7bKIe7TyRgCLDNh1PVRJBuibEZ3mG6c00LHLtCWy0Oxl5Ip8Qv9iueHnKypM6PjqQ0qUH7793Mq_rFlqjqMYA Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:13:56.277772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:13:56.279423 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:13:56.279423 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:13:56.279423 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:13:56.279423 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:13:56.279423 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:13:56.279423 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:13:56.279423 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:13:56.279423 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: 51768890f19140b6819ef89f5bf610c8 Sep 14 01:13:56.279423 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:13:56.279423 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Sep 14 01:13:56.279423 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {"volumeAttachment": {"volumeId": "15920cb3-7dec-40f3-b2e6-080c1d579168"}} Sep 14 01:13:56.279423 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:13:56.280272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Invalid volume: volume 15920cb3-7dec-40f3-b2e6-080c1d579168 is already attached to instances: 49f5ab2e-e424-49af-81ac-dc4b94c742b9 Sep 14 01:13:56.280272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'server_id': '49f5ab2e-e424-49af-81ac-dc4b94c742b9', 'body': {'volumeAttachment': {'volumeId': '15920cb3-7dec-40f3-b2e6-080c1d579168'}}} Sep 14 01:13:56.280272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:13:56.280272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:13:56.280272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 14 01:13:56.280272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 14 01:13:56.280272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 01:13:56.280272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 01:13:56.280272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 14 01:13:56.280272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 01:13:56.280272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 14 01:13:56.280272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 14 01:13:56.280272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 14 01:13:56.280272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 14 01:13:56.280272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 15920cb3-7dec-40f3-b2e6-080c1d579168 is already attached to instances: 49f5ab2e-e424-49af-81ac-dc4b94c742b9 Sep 14 01:13:56.280272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:13:56.280272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:13:56.280272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:13:56.280272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:13:56.281533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:13:56.281533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:13:56.281533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:13:56.281533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:13:56.281533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:13:56.281533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:13:56.281533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 01:13:56.281533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 01:13:56.281533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 01:13:56.281533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 01:13:56.281533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 01:13:56.281533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 01:13:56.281533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 14 01:13:56.281533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 14 01:13:56.281533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 15920cb3-7dec-40f3-b2e6-080c1d579168 is already attached to instances: 49f5ab2e-e424-49af-81ac-dc4b94c742b9 Sep 14 01:13:56.281533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:13:56.281533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:13:56.281533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:13:56.281533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:13:56.281533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:13:56.282773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:13:56.282773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:13:56.282773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:13:56.282773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 15920cb3-7dec-40f3-b2e6-080c1d579168 is already attached to instances: 49f5ab2e-e424-49af-81ac-dc4b94c742b9 Sep 14 01:13:56.282773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:13:56.282773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-60c71b71-9891-45f2-be7f-b47c4cff6476 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Returning 400 to user: Invalid volume: volume 15920cb3-7dec-40f3-b2e6-080c1d579168 is already attached to instances: 49f5ab2e-e424-49af-81ac-dc4b94c742b9 {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:13:56.282773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-60c71b71-9891-45f2-be7f-b47c4cff6476 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "POST /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099568 Sep 14 01:13:56.282773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 456/907] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 01:13:56 2022] POST /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 14 01:13:56.344220 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9216601e-e640-4dc0-a47e-01d40e24c789 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:56.344713 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9216601e-e640-4dc0-a47e-01d40e24c789 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:56.350579 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9216601e-e640-4dc0-a47e-01d40e24c789 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:56.351058 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9216601e-e640-4dc0-a47e-01d40e24c789 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:56.351488 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9216601e-e640-4dc0-a47e-01d40e24c789 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:56.352193 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9216601e-e640-4dc0-a47e-01d40e24c789 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:56.352643 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9216601e-e640-4dc0-a47e-01d40e24c789 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:56.353059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9216601e-e640-4dc0-a47e-01d40e24c789 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:56.431639 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-9216601e-e640-4dc0-a47e-01d40e24c789 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lazy-loading 'services' on Instance uuid 49f5ab2e-e424-49af-81ac-dc4b94c742b9 {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:13:56.504247 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9216601e-e640-4dc0-a47e-01d40e24c789 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "DELETE /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9/os-volume_attachments/15920cb3-7dec-40f3-b2e6-080c1d579168" status: 202 len: 0 microversion: 2.1 time: 0.163727 Sep 14 01:13:56.504824 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 452/908] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 01:13:56 2022] DELETE /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9/os-volume_attachments/15920cb3-7dec-40f3-b2e6-080c1d579168 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:13:56.513377 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-aa2c7a6b-ea55-4b48-9d3a-3a02f2193f51 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:56.515518 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-aa2c7a6b-ea55-4b48-9d3a-3a02f2193f51 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:56.521734 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa2c7a6b-ea55-4b48-9d3a-3a02f2193f51 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:56.522388 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa2c7a6b-ea55-4b48-9d3a-3a02f2193f51 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:56.522823 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa2c7a6b-ea55-4b48-9d3a-3a02f2193f51 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:56.523508 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa2c7a6b-ea55-4b48-9d3a-3a02f2193f51 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:56.523988 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa2c7a6b-ea55-4b48-9d3a-3a02f2193f51 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:56.524410 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-aa2c7a6b-ea55-4b48-9d3a-3a02f2193f51 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:56.554845 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-aa2c7a6b-ea55-4b48-9d3a-3a02f2193f51 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045340 Sep 14 01:13:56.555387 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 457/909] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 01:13:56 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:13:56.806486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-feed7623-fa91-4ba6-a272-8a953bd99c7a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:56.807182 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-feed7623-fa91-4ba6-a272-8a953bd99c7a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:56.813333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-feed7623-fa91-4ba6-a272-8a953bd99c7a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:56.813809 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-feed7623-fa91-4ba6-a272-8a953bd99c7a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:56.814243 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-feed7623-fa91-4ba6-a272-8a953bd99c7a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:56.814930 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-feed7623-fa91-4ba6-a272-8a953bd99c7a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:56.815381 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-feed7623-fa91-4ba6-a272-8a953bd99c7a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:56.815827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-feed7623-fa91-4ba6-a272-8a953bd99c7a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:56.944808 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-94420628-6e9f-466f-aeeb-3ba4dfd36f9e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:56.945422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-94420628-6e9f-466f-aeeb-3ba4dfd36f9e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:56.945605 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-feed7623-fa91-4ba6-a272-8a953bd99c7a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:56.951853 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-94420628-6e9f-466f-aeeb-3ba4dfd36f9e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:56.952337 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-94420628-6e9f-466f-aeeb-3ba4dfd36f9e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:56.952773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-94420628-6e9f-466f-aeeb-3ba4dfd36f9e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:56.953464 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-94420628-6e9f-466f-aeeb-3ba4dfd36f9e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:56.953916 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-94420628-6e9f-466f-aeeb-3ba4dfd36f9e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:56.954027 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-feed7623-fa91-4ba6-a272-8a953bd99c7a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:56.954337 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-94420628-6e9f-466f-aeeb-3ba4dfd36f9e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:56.955421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-feed7623-fa91-4ba6-a272-8a953bd99c7a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:56.956623 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-feed7623-fa91-4ba6-a272-8a953bd99c7a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.155509 Sep 14 01:13:56.957175 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 453/910] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:13:56 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:13:57.080446 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-94420628-6e9f-466f-aeeb-3ba4dfd36f9e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:57.088024 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-94420628-6e9f-466f-aeeb-3ba4dfd36f9e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1358 microversion: 2.1 time: 0.147667 Sep 14 01:13:57.088583 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 458/911] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:56 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:13:57.567318 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d0c2defe-f4bd-4486-9c20-d3f28bba4ae5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:57.569602 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d0c2defe-f4bd-4486-9c20-d3f28bba4ae5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:57.575510 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d0c2defe-f4bd-4486-9c20-d3f28bba4ae5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:57.576022 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d0c2defe-f4bd-4486-9c20-d3f28bba4ae5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:57.576486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d0c2defe-f4bd-4486-9c20-d3f28bba4ae5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:57.577173 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d0c2defe-f4bd-4486-9c20-d3f28bba4ae5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:57.577629 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d0c2defe-f4bd-4486-9c20-d3f28bba4ae5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:57.578053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d0c2defe-f4bd-4486-9c20-d3f28bba4ae5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:57.603298 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:13:57.608413 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d0c2defe-f4bd-4486-9c20-d3f28bba4ae5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045112 Sep 14 01:13:57.608965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 454/912] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 01:13:57 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:13:57.982017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0a8c9f70-e3bd-4061-aea0-24648019cfaa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:57.982627 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0a8c9f70-e3bd-4061-aea0-24648019cfaa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:57.989149 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0a8c9f70-e3bd-4061-aea0-24648019cfaa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:57.989622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0a8c9f70-e3bd-4061-aea0-24648019cfaa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:57.990192 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0a8c9f70-e3bd-4061-aea0-24648019cfaa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:57.991092 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0a8c9f70-e3bd-4061-aea0-24648019cfaa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:57.991544 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0a8c9f70-e3bd-4061-aea0-24648019cfaa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:57.991986 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0a8c9f70-e3bd-4061-aea0-24648019cfaa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:58.111952 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e232c556-0900-470a-88c6-9734d98257e7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:58.112568 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-e232c556-0900-470a-88c6-9734d98257e7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:58.120040 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e232c556-0900-470a-88c6-9734d98257e7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:58.120532 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e232c556-0900-470a-88c6-9734d98257e7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:58.120978 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e232c556-0900-470a-88c6-9734d98257e7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:58.121675 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e232c556-0900-470a-88c6-9734d98257e7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:58.122133 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e232c556-0900-470a-88c6-9734d98257e7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:58.122563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e232c556-0900-470a-88c6-9734d98257e7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:58.126833 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0a8c9f70-e3bd-4061-aea0-24648019cfaa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:58.135839 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0a8c9f70-e3bd-4061-aea0-24648019cfaa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:58.137291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0a8c9f70-e3bd-4061-aea0-24648019cfaa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:58.138455 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0a8c9f70-e3bd-4061-aea0-24648019cfaa tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.160412 Sep 14 01:13:58.139025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 459/913] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:13:57 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:13:58.254585 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e232c556-0900-470a-88c6-9734d98257e7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:58.263170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-e232c556-0900-470a-88c6-9734d98257e7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1358 microversion: 2.1 time: 0.155023 Sep 14 01:13:58.263762 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 455/914] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:58 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:13:58.621403 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-712cfe1d-e754-4e24-9962-960dceb490f3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:58.623670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-712cfe1d-e754-4e24-9962-960dceb490f3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:58.629843 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-712cfe1d-e754-4e24-9962-960dceb490f3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:58.630333 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-712cfe1d-e754-4e24-9962-960dceb490f3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:58.631379 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-712cfe1d-e754-4e24-9962-960dceb490f3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:58.633017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-712cfe1d-e754-4e24-9962-960dceb490f3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:58.633017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-712cfe1d-e754-4e24-9962-960dceb490f3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:58.633372 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-712cfe1d-e754-4e24-9962-960dceb490f3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:58.665778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-712cfe1d-e754-4e24-9962-960dceb490f3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048274 Sep 14 01:13:58.666334 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 460/915] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 01:13:58 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:13:59.164233 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-92f26e5c-e468-4e16-99ba-46bb6fe35682 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:59.164865 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-92f26e5c-e468-4e16-99ba-46bb6fe35682 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:59.173286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-92f26e5c-e468-4e16-99ba-46bb6fe35682 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:59.174169 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-92f26e5c-e468-4e16-99ba-46bb6fe35682 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:59.174954 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-92f26e5c-e468-4e16-99ba-46bb6fe35682 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:59.176233 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-92f26e5c-e468-4e16-99ba-46bb6fe35682 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:59.177070 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-92f26e5c-e468-4e16-99ba-46bb6fe35682 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:59.177861 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-92f26e5c-e468-4e16-99ba-46bb6fe35682 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:59.286116 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9389a355-42a2-46d0-a25f-5ab1237f7099 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:59.287313 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9389a355-42a2-46d0-a25f-5ab1237f7099 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:59.293967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9389a355-42a2-46d0-a25f-5ab1237f7099 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:59.294444 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9389a355-42a2-46d0-a25f-5ab1237f7099 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:59.294873 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9389a355-42a2-46d0-a25f-5ab1237f7099 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:59.295581 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9389a355-42a2-46d0-a25f-5ab1237f7099 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:59.296130 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9389a355-42a2-46d0-a25f-5ab1237f7099 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:59.296548 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9389a355-42a2-46d0-a25f-5ab1237f7099 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:59.314959 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-92f26e5c-e468-4e16-99ba-46bb6fe35682 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:59.323433 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-92f26e5c-e468-4e16-99ba-46bb6fe35682 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:59.324970 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-92f26e5c-e468-4e16-99ba-46bb6fe35682 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:59.326449 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-92f26e5c-e468-4e16-99ba-46bb6fe35682 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.166652 Sep 14 01:13:59.327025 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 456/916] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:13:59 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:13:59.426941 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9389a355-42a2-46d0-a25f-5ab1237f7099 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:13:59.435300 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9389a355-42a2-46d0-a25f-5ab1237f7099 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1358 microversion: 2.1 time: 0.153027 Sep 14 01:13:59.435882 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 461/917] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:59 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:13:59.680277 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-770a5463-6a2f-4f76-8861-5afd12fa3171 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:59.682478 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-770a5463-6a2f-4f76-8861-5afd12fa3171 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:59.689384 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-770a5463-6a2f-4f76-8861-5afd12fa3171 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:59.690593 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-770a5463-6a2f-4f76-8861-5afd12fa3171 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:59.691117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-770a5463-6a2f-4f76-8861-5afd12fa3171 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:59.691832 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-770a5463-6a2f-4f76-8861-5afd12fa3171 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:59.692510 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-770a5463-6a2f-4f76-8861-5afd12fa3171 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:59.693057 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-770a5463-6a2f-4f76-8861-5afd12fa3171 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:59.722881 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-770a5463-6a2f-4f76-8861-5afd12fa3171 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047997 Sep 14 01:13:59.723435 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 457/918] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 01:13:59 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 01:13:59.786071 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-54504c91-2a54-4015-897d-57787ae45734 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:59.786572 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-54504c91-2a54-4015-897d-57787ae45734 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:59.793120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54504c91-2a54-4015-897d-57787ae45734 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:59.793601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54504c91-2a54-4015-897d-57787ae45734 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:59.794037 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54504c91-2a54-4015-897d-57787ae45734 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:59.794722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54504c91-2a54-4015-897d-57787ae45734 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:59.795176 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54504c91-2a54-4015-897d-57787ae45734 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:59.795625 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54504c91-2a54-4015-897d-57787ae45734 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:59.820642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-54504c91-2a54-4015-897d-57787ae45734 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Going to try to terminate instance {{(pid=120621) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:13:59.893406 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-54504c91-2a54-4015-897d-57787ae45734 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "DELETE /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 204 len: 0 microversion: 2.1 time: 0.110787 Sep 14 01:13:59.894090 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 462/919] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:13:59 2022] DELETE /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 01:13:59.903529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7d8ad1a4-996e-44c7-baf7-7181359586cf tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:13:59.904166 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7d8ad1a4-996e-44c7-baf7-7181359586cf tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:13:59.910056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7d8ad1a4-996e-44c7-baf7-7181359586cf tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:59.910541 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7d8ad1a4-996e-44c7-baf7-7181359586cf tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:59.911188 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7d8ad1a4-996e-44c7-baf7-7181359586cf tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:13:59.912519 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7d8ad1a4-996e-44c7-baf7-7181359586cf tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:13:59.912979 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7d8ad1a4-996e-44c7-baf7-7181359586cf tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:13:59.913406 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7d8ad1a4-996e-44c7-baf7-7181359586cf tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:00.046065 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7d8ad1a4-996e-44c7-baf7-7181359586cf tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:00.054619 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7d8ad1a4-996e-44c7-baf7-7181359586cf tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 200 len: 1679 microversion: 2.1 time: 0.154936 Sep 14 01:14:00.055174 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 458/920] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:13:59 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:14:00.353076 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a4dcf37a-e7fa-4a39-9020-c9434bf234ba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:00.353683 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a4dcf37a-e7fa-4a39-9020-c9434bf234ba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:00.360050 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a4dcf37a-e7fa-4a39-9020-c9434bf234ba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:00.360533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a4dcf37a-e7fa-4a39-9020-c9434bf234ba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:00.360963 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a4dcf37a-e7fa-4a39-9020-c9434bf234ba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:00.361644 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a4dcf37a-e7fa-4a39-9020-c9434bf234ba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:00.362091 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a4dcf37a-e7fa-4a39-9020-c9434bf234ba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:00.362508 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a4dcf37a-e7fa-4a39-9020-c9434bf234ba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:00.458146 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-54fd6e86-5950-4b3e-9df9-7a5adadc9a1c tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:00.458938 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-54fd6e86-5950-4b3e-9df9-7a5adadc9a1c tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:00.465406 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-54fd6e86-5950-4b3e-9df9-7a5adadc9a1c tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:00.465891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-54fd6e86-5950-4b3e-9df9-7a5adadc9a1c tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:00.466331 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-54fd6e86-5950-4b3e-9df9-7a5adadc9a1c tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:00.467023 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-54fd6e86-5950-4b3e-9df9-7a5adadc9a1c tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:00.467506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-54fd6e86-5950-4b3e-9df9-7a5adadc9a1c tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:00.472563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-54fd6e86-5950-4b3e-9df9-7a5adadc9a1c tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:00.497359 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a4dcf37a-e7fa-4a39-9020-c9434bf234ba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:00.505436 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a4dcf37a-e7fa-4a39-9020-c9434bf234ba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:00.507613 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a4dcf37a-e7fa-4a39-9020-c9434bf234ba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:00.508788 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a4dcf37a-e7fa-4a39-9020-c9434bf234ba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.160748 Sep 14 01:14:00.509350 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 463/921] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:00 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:00.600325 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-54fd6e86-5950-4b3e-9df9-7a5adadc9a1c tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:00.607906 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-54fd6e86-5950-4b3e-9df9-7a5adadc9a1c tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1358 microversion: 2.1 time: 0.153586 Sep 14 01:14:00.608413 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 459/922] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:00 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:14:00.955520 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-0b5d8bf5-96ec-4bb8-8ba9-ad50f929e4eb req-cb859c31-74d2-42ec-88ce-32684a6368cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c532d078-01eb-4150-8869-3c33a457898c", "name": "network-vif-plugged", "status": "completed", "tag": "78292043-7571-4bbd-b478-4125b485b189"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:14:00.966133 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-0b5d8bf5-96ec-4bb8-8ba9-ad50f929e4eb req-cb859c31-74d2-42ec-88ce-32684a6368cb service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:00.967239 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-0b5d8bf5-96ec-4bb8-8ba9-ad50f929e4eb req-cb859c31-74d2-42ec-88ce-32684a6368cb service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:00.967730 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-0b5d8bf5-96ec-4bb8-8ba9-ad50f929e4eb req-cb859c31-74d2-42ec-88ce-32684a6368cb service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:00.979660 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-0b5d8bf5-96ec-4bb8-8ba9-ad50f929e4eb req-cb859c31-74d2-42ec-88ce-32684a6368cb service nova] Creating event network-vif-plugged:78292043-7571-4bbd-b478-4125b485b189 for instance c532d078-01eb-4150-8869-3c33a457898c on hv-cinder-85752 Sep 14 01:14:00.984519 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-0b5d8bf5-96ec-4bb8-8ba9-ad50f929e4eb req-cb859c31-74d2-42ec-88ce-32684a6368cb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032754 Sep 14 01:14:00.985113 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 464/923] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:14:01.078070 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ec5d35ad-d3af-4d44-9553-d383e5dc4057 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:01.078708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ec5d35ad-d3af-4d44-9553-d383e5dc4057 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:01.084669 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec5d35ad-d3af-4d44-9553-d383e5dc4057 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:01.085148 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec5d35ad-d3af-4d44-9553-d383e5dc4057 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:01.086196 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec5d35ad-d3af-4d44-9553-d383e5dc4057 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:01.086881 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec5d35ad-d3af-4d44-9553-d383e5dc4057 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:01.087327 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec5d35ad-d3af-4d44-9553-d383e5dc4057 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:01.087873 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec5d35ad-d3af-4d44-9553-d383e5dc4057 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:01.220249 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ec5d35ad-d3af-4d44-9553-d383e5dc4057 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:01.228742 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ec5d35ad-d3af-4d44-9553-d383e5dc4057 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 200 len: 1679 microversion: 2.1 time: 0.154300 Sep 14 01:14:01.229279 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 460/924] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:01 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:14:01.533944 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-623aa737-3485-4db7-bdea-12f952ba2c79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:01.534639 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-623aa737-3485-4db7-bdea-12f952ba2c79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:01.541459 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-623aa737-3485-4db7-bdea-12f952ba2c79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:01.541943 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-623aa737-3485-4db7-bdea-12f952ba2c79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:01.542382 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-623aa737-3485-4db7-bdea-12f952ba2c79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:01.543074 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-623aa737-3485-4db7-bdea-12f952ba2c79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:01.543529 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-623aa737-3485-4db7-bdea-12f952ba2c79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:01.543976 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-623aa737-3485-4db7-bdea-12f952ba2c79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:01.630542 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9ca725f5-2a70-409d-9a22-3514cf1f61c8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:01.631153 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9ca725f5-2a70-409d-9a22-3514cf1f61c8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:01.638440 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9ca725f5-2a70-409d-9a22-3514cf1f61c8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:01.638929 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9ca725f5-2a70-409d-9a22-3514cf1f61c8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:01.639365 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9ca725f5-2a70-409d-9a22-3514cf1f61c8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:01.640085 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9ca725f5-2a70-409d-9a22-3514cf1f61c8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:01.640539 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9ca725f5-2a70-409d-9a22-3514cf1f61c8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:01.640963 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9ca725f5-2a70-409d-9a22-3514cf1f61c8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:01.674311 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-623aa737-3485-4db7-bdea-12f952ba2c79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:01.683247 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-623aa737-3485-4db7-bdea-12f952ba2c79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:01.684738 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-623aa737-3485-4db7-bdea-12f952ba2c79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:01.685916 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-623aa737-3485-4db7-bdea-12f952ba2c79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.156200 Sep 14 01:14:01.686477 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 465/925] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:01 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:01.769076 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9ca725f5-2a70-409d-9a22-3514cf1f61c8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:01.777155 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9ca725f5-2a70-409d-9a22-3514cf1f61c8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1358 microversion: 2.1 time: 0.150427 Sep 14 01:14:01.777711 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 461/926] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:01 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:14:02.252159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-865387f4-7acc-43f5-a421-3b0d81104055 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:02.252800 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-865387f4-7acc-43f5-a421-3b0d81104055 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:02.259611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-865387f4-7acc-43f5-a421-3b0d81104055 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:02.260102 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-865387f4-7acc-43f5-a421-3b0d81104055 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:02.260540 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-865387f4-7acc-43f5-a421-3b0d81104055 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:02.261228 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-865387f4-7acc-43f5-a421-3b0d81104055 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:02.261688 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-865387f4-7acc-43f5-a421-3b0d81104055 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:02.262115 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-865387f4-7acc-43f5-a421-3b0d81104055 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:02.389495 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-865387f4-7acc-43f5-a421-3b0d81104055 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:02.397189 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-865387f4-7acc-43f5-a421-3b0d81104055 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 200 len: 1679 microversion: 2.1 time: 0.149022 Sep 14 01:14:02.397815 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 466/927] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:02 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:14:02.711549 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-bacd3f4a-637a-4e88-967a-627de8146cff tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:02.712178 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-bacd3f4a-637a-4e88-967a-627de8146cff tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:02.718635 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bacd3f4a-637a-4e88-967a-627de8146cff tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:02.719119 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bacd3f4a-637a-4e88-967a-627de8146cff tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:02.719567 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bacd3f4a-637a-4e88-967a-627de8146cff tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:02.720278 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bacd3f4a-637a-4e88-967a-627de8146cff tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:02.720730 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bacd3f4a-637a-4e88-967a-627de8146cff tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:02.721147 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bacd3f4a-637a-4e88-967a-627de8146cff tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:02.800304 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d853a457-1166-42bb-ac28-01649c3f6662 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:02.800907 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d853a457-1166-42bb-ac28-01649c3f6662 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:02.807947 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d853a457-1166-42bb-ac28-01649c3f6662 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:02.808433 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d853a457-1166-42bb-ac28-01649c3f6662 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:02.808872 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d853a457-1166-42bb-ac28-01649c3f6662 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:02.809572 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d853a457-1166-42bb-ac28-01649c3f6662 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:02.810035 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d853a457-1166-42bb-ac28-01649c3f6662 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:02.810463 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d853a457-1166-42bb-ac28-01649c3f6662 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:02.924202 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bacd3f4a-637a-4e88-967a-627de8146cff tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:02.933604 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bacd3f4a-637a-4e88-967a-627de8146cff tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:02.935069 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bacd3f4a-637a-4e88-967a-627de8146cff tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:02.936655 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-bacd3f4a-637a-4e88-967a-627de8146cff tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.228976 Sep 14 01:14:02.945285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 462/928] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:02 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:02.947362 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d853a457-1166-42bb-ac28-01649c3f6662 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:02.955822 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d853a457-1166-42bb-ac28-01649c3f6662 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1358 microversion: 2.1 time: 0.159354 Sep 14 01:14:02.956586 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 467/929] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:02 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:14:03.420261 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8da7e100-20ee-4ef7-9645-66c1990512ac tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:03.420882 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8da7e100-20ee-4ef7-9645-66c1990512ac tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:03.426952 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8da7e100-20ee-4ef7-9645-66c1990512ac tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:03.427447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8da7e100-20ee-4ef7-9645-66c1990512ac tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:03.427923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8da7e100-20ee-4ef7-9645-66c1990512ac tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:03.428622 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8da7e100-20ee-4ef7-9645-66c1990512ac tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:03.429852 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8da7e100-20ee-4ef7-9645-66c1990512ac tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:03.430287 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8da7e100-20ee-4ef7-9645-66c1990512ac tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:03.515481 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8da7e100-20ee-4ef7-9645-66c1990512ac tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:03.523396 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8da7e100-20ee-4ef7-9645-66c1990512ac tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 200 len: 1612 microversion: 2.1 time: 0.106951 Sep 14 01:14:03.524198 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 463/930] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:03 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 1612 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:14:03.692288 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-2aa7e5f2-1321-46e4-839a-1e3422fe4b4a req-d5bb8b2e-a38c-47ac-b705-89782742412e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f5ab2e-e424-49af-81ac-dc4b94c742b9", "name": "network-vif-deleted", "tag": "07c78368-62fe-4df7-9562-b7b0093b41a9"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:14:03.705090 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-2aa7e5f2-1321-46e4-839a-1e3422fe4b4a req-d5bb8b2e-a38c-47ac-b705-89782742412e service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:03.706075 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-2aa7e5f2-1321-46e4-839a-1e3422fe4b4a req-d5bb8b2e-a38c-47ac-b705-89782742412e service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:03.706565 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-2aa7e5f2-1321-46e4-839a-1e3422fe4b4a req-d5bb8b2e-a38c-47ac-b705-89782742412e service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:03.720581 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-2aa7e5f2-1321-46e4-839a-1e3422fe4b4a req-d5bb8b2e-a38c-47ac-b705-89782742412e service nova] Creating event network-vif-deleted:07c78368-62fe-4df7-9562-b7b0093b41a9 for instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 on hv-cinder-85752 Sep 14 01:14:03.727534 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-2aa7e5f2-1321-46e4-839a-1e3422fe4b4a req-d5bb8b2e-a38c-47ac-b705-89782742412e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038434 Sep 14 01:14:03.728174 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 468/931] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:14:03.962652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-090f15f9-2d2e-4370-aa16-6109b1e5ffda tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:03.963267 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-090f15f9-2d2e-4370-aa16-6109b1e5ffda tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:03.969898 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-090f15f9-2d2e-4370-aa16-6109b1e5ffda tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:03.970640 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-090f15f9-2d2e-4370-aa16-6109b1e5ffda tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:03.971124 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-090f15f9-2d2e-4370-aa16-6109b1e5ffda tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:03.973305 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-090f15f9-2d2e-4370-aa16-6109b1e5ffda tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:03.973781 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-090f15f9-2d2e-4370-aa16-6109b1e5ffda tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:03.974220 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-090f15f9-2d2e-4370-aa16-6109b1e5ffda tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:03.979266 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f273773d-a125-45bd-8839-78e07b6180c3 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:03.980087 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f273773d-a125-45bd-8839-78e07b6180c3 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:03.987395 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f273773d-a125-45bd-8839-78e07b6180c3 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:03.989816 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f273773d-a125-45bd-8839-78e07b6180c3 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:03.990473 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f273773d-a125-45bd-8839-78e07b6180c3 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:03.991187 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f273773d-a125-45bd-8839-78e07b6180c3 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:03.991883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f273773d-a125-45bd-8839-78e07b6180c3 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:03.992318 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f273773d-a125-45bd-8839-78e07b6180c3 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:04.144634 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f273773d-a125-45bd-8839-78e07b6180c3 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:04.146818 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-090f15f9-2d2e-4370-aa16-6109b1e5ffda tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:04.153324 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f273773d-a125-45bd-8839-78e07b6180c3 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1548 microversion: 2.1 time: 0.178609 Sep 14 01:14:04.154197 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 469/932] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:03 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1548 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:14:04.158722 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-090f15f9-2d2e-4370-aa16-6109b1e5ffda tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:04.158722 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-090f15f9-2d2e-4370-aa16-6109b1e5ffda tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:04.158950 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-090f15f9-2d2e-4370-aa16-6109b1e5ffda tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.200907 Sep 14 01:14:04.159443 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 464/933] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:03 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:04.177321 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c16cbca4-1b04-4eb4-9e4a-7fc2c6f857a2 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:04.177937 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c16cbca4-1b04-4eb4-9e4a-7fc2c6f857a2 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:04.185128 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c16cbca4-1b04-4eb4-9e4a-7fc2c6f857a2 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:04.185624 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c16cbca4-1b04-4eb4-9e4a-7fc2c6f857a2 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:04.186064 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c16cbca4-1b04-4eb4-9e4a-7fc2c6f857a2 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:04.186782 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c16cbca4-1b04-4eb4-9e4a-7fc2c6f857a2 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:04.187235 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c16cbca4-1b04-4eb4-9e4a-7fc2c6f857a2 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:04.187684 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c16cbca4-1b04-4eb4-9e4a-7fc2c6f857a2 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:04.327275 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c16cbca4-1b04-4eb4-9e4a-7fc2c6f857a2 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:04.336662 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c16cbca4-1b04-4eb4-9e4a-7fc2c6f857a2 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1548 microversion: 2.1 time: 0.163142 Sep 14 01:14:04.337603 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 470/934] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:04 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:14:04.365605 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ecc2067b-7a0f-46d6-944f-8efbe37d7597 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:04.372217 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ecc2067b-7a0f-46d6-944f-8efbe37d7597 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:04.372884 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ecc2067b-7a0f-46d6-944f-8efbe37d7597 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Searching by: {'deleted': False, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4'} {{(pid=120620) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 01:14:04.379967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ecc2067b-7a0f-46d6-944f-8efbe37d7597 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:04.380706 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ecc2067b-7a0f-46d6-944f-8efbe37d7597 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:04.381143 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ecc2067b-7a0f-46d6-944f-8efbe37d7597 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:04.382884 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ecc2067b-7a0f-46d6-944f-8efbe37d7597 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:04.383765 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ecc2067b-7a0f-46d6-944f-8efbe37d7597 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:04.384314 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ecc2067b-7a0f-46d6-944f-8efbe37d7597 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:04.477945 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.multi_cell_list [None req-ecc2067b-7a0f-46d6-944f-8efbe37d7597 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120620) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 01:14:04.546586 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-bb3c619c-016c-4b86-a52f-605e08641c61 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:04.547400 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-bb3c619c-016c-4b86-a52f-605e08641c61 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:04.553697 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bb3c619c-016c-4b86-a52f-605e08641c61 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:04.554806 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bb3c619c-016c-4b86-a52f-605e08641c61 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:04.555333 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bb3c619c-016c-4b86-a52f-605e08641c61 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:04.556522 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bb3c619c-016c-4b86-a52f-605e08641c61 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:04.557083 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bb3c619c-016c-4b86-a52f-605e08641c61 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:04.557594 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bb3c619c-016c-4b86-a52f-605e08641c61 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:04.572759 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-bb3c619c-016c-4b86-a52f-605e08641c61 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] HTTP exception thrown: Instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 could not be found. Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-bb3c619c-016c-4b86-a52f-605e08641c61 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Request method failure captured: Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 HTTP/1.1 Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISi3fXiNfssV-9suzyOi_X569sc3LzFc1vlFMuwkYOTf31lKxNzFY-VkibuUEPaC7Cvi81CQQfr4-r5n6Uvso8OzNo7bKIe7TyRgCLDNh1PVRJBuibEZ3mG6c00LHLtCWy0Oxl5Ip8Qv9iueHnKypM6PjqQ0qUH7793Mq_rFlqjqMYA Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:14:04.574911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:14:04.576427 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:14:04.576427 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:14:04.576427 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:14:04.576427 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:14:04.576427 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:14:04.576427 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:14:04.576427 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:14:04.576427 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: 51768890f19140b6819ef89f5bf610c8 Sep 14 01:14:04.576427 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:14:04.576427 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:14:04.576427 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 could not be found. Sep 14 01:14:04.576427 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': '49f5ab2e-e424-49af-81ac-dc4b94c742b9'} Sep 14 01:14:04.577592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:14:04.577592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:14:04.577592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:14:04.577592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:14:04.577592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:14:04.577592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:14:04.577592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:14:04.577592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:14:04.577592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:14:04.577592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:14:04.577592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 could not be found. Sep 14 01:14:04.577592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:14:04.577592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:14:04.577592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:14:04.577592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:14:04.577592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:14:04.577592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:14:04.577592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:14:04.577592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:14:04.577592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:14:04.579198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:14:04.579198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:14:04.579198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:14:04.579198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:14:04.579198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:14:04.579198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:14:04.579198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:14:04.579198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 could not be found. Sep 14 01:14:04.579198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:14:04.579198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:14:04.579198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:14:04.579198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:14:04.579198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:14:04.579198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:14:04.579198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:14:04.579198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:14:04.579198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 could not be found. Sep 14 01:14:04.579198 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:14:04.580848 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-bb3c619c-016c-4b86-a52f-605e08641c61 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Returning 404 to user: Instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:14:04.580848 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-bb3c619c-016c-4b86-a52f-605e08641c61 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 404 len: 111 microversion: 2.1 time: 0.033986 Sep 14 01:14:04.580848 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 471/935] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:04 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 01:14:04.583197 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ecc2067b-7a0f-46d6-944f-8efbe37d7597 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.225406 Sep 14 01:14:04.583878 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 465/936] 10.222.0.42 () {58 vars in 1125 bytes} [Wed Sep 14 01:14:04 2022] GET /compute/v2.1/servers => generated 343 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:14:04.585131 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-eb08d0f3-22ea-4f26-9126-763d8b2975e9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '.version_select at 0x7f5043cc9b80>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:04.596054 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-13ff1427-5e05-4e39-9c4f-840444c8f439 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:04.596663 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-13ff1427-5e05-4e39-9c4f-840444c8f439 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:04.603059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-13ff1427-5e05-4e39-9c4f-840444c8f439 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:04.603635 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-13ff1427-5e05-4e39-9c4f-840444c8f439 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:04.604024 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-13ff1427-5e05-4e39-9c4f-840444c8f439 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:04.604729 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-13ff1427-5e05-4e39-9c4f-840444c8f439 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:04.605172 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-13ff1427-5e05-4e39-9c4f-840444c8f439 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:04.605435 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-eb08d0f3-22ea-4f26-9126-763d8b2975e9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-988477203" status: 202 len: 0 microversion: 2.1 time: 0.023878 Sep 14 01:14:04.605592 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-13ff1427-5e05-4e39-9c4f-840444c8f439 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:04.605968 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 472/937] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Sep 14 01:14:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-988477203 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:14:04.752880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-13ff1427-5e05-4e39-9c4f-840444c8f439 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:04.762574 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-13ff1427-5e05-4e39-9c4f-840444c8f439 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1548 microversion: 2.1 time: 0.170214 Sep 14 01:14:04.771602 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 466/938] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:04 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:14:05.191289 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-57880edc-a104-40b8-97c0-d022ad171a43 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:05.191996 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-57880edc-a104-40b8-97c0-d022ad171a43 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:05.199495 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-57880edc-a104-40b8-97c0-d022ad171a43 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:05.200007 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-57880edc-a104-40b8-97c0-d022ad171a43 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:05.200849 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-57880edc-a104-40b8-97c0-d022ad171a43 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:05.202149 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-57880edc-a104-40b8-97c0-d022ad171a43 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:05.202830 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-57880edc-a104-40b8-97c0-d022ad171a43 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:05.203259 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-57880edc-a104-40b8-97c0-d022ad171a43 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:05.350525 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-57880edc-a104-40b8-97c0-d022ad171a43 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:05.360773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-57880edc-a104-40b8-97c0-d022ad171a43 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:05.362232 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-57880edc-a104-40b8-97c0-d022ad171a43 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:05.363427 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-57880edc-a104-40b8-97c0-d022ad171a43 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.176700 Sep 14 01:14:05.364219 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 473/939] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:05 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:05.514084 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-41ede6f8-7ce0-4fe6-95ec-765695430eb1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Action: 'create', calling method: .version_select at 0x7f5043e20550>, body: {"keypair": {"name": "tempest-keypair-1274343025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrSVlIgWFfXkYpbSeqnccJSV7Xb+TEYNoqbGqnVI9pwBF36Gwd2J1Yhe0e+decig0pbNGsGuQcY/IB7pDrW7CcUhoX/rmQJPB/5qITteORJbipvZYkjB8nslmOuqRH7HQ=="}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:14:05.529571 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-41ede6f8-7ce0-4fe6-95ec-765695430eb1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Getting quotas for project 62cb41eb4b8244abb4aafd718b1207ad. Resources: {'key_pairs'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:14:05.533291 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-41ede6f8-7ce0-4fe6-95ec-765695430eb1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Getting quotas for user 51768890f19140b6819ef89f5bf610c8 and project 62cb41eb4b8244abb4aafd718b1207ad. Resources: {'key_pairs'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:14:05.555485 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-41ede6f8-7ce0-4fe6-95ec-765695430eb1 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045293 Sep 14 01:14:05.556027 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 467/940] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Sep 14 01:14:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:14:06.390491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c8002352-6566-4296-8aca-fe461c5004d6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:06.391099 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c8002352-6566-4296-8aca-fe461c5004d6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:06.399235 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c8002352-6566-4296-8aca-fe461c5004d6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:06.400046 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c8002352-6566-4296-8aca-fe461c5004d6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:06.400572 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c8002352-6566-4296-8aca-fe461c5004d6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:06.401367 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c8002352-6566-4296-8aca-fe461c5004d6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:06.401892 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c8002352-6566-4296-8aca-fe461c5004d6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:06.402393 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c8002352-6566-4296-8aca-fe461c5004d6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:06.406956 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:06.435962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9298f97f-2d12-471e-914d-0e382bcd943d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7bb3e18-9b4e-40c0-b310-58f821bc65d5"}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:14:06.438774 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9298f97f-2d12-471e-914d-0e382bcd943d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:06.444985 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:06.447237 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9298f97f-2d12-471e-914d-0e382bcd943d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:06.447900 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9298f97f-2d12-471e-914d-0e382bcd943d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:06.448350 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9298f97f-2d12-471e-914d-0e382bcd943d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:06.449213 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9298f97f-2d12-471e-914d-0e382bcd943d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:06.449682 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9298f97f-2d12-471e-914d-0e382bcd943d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:06.450113 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9298f97f-2d12-471e-914d-0e382bcd943d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:06.551448 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c8002352-6566-4296-8aca-fe461c5004d6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:06.560948 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c8002352-6566-4296-8aca-fe461c5004d6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:06.562591 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c8002352-6566-4296-8aca-fe461c5004d6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:06.563767 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c8002352-6566-4296-8aca-fe461c5004d6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.177393 Sep 14 01:14:06.564319 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 474/941] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:06 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:06.749123 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9298f97f-2d12-471e-914d-0e382bcd943d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "POST /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316796 Sep 14 01:14:06.749787 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 468/942] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 01:14:06 2022] POST /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:14:06.879171 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-844f9da4-c31c-49d5-8b33-1afd66a04afc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2032806201", "imageRef": "a2619027-0d8b-4ca3-9528-1ac3380cab5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a458fb77-0452-4eef-a570-bd92e833719b"}], "security_groups": [{"name": "tempest-securitygroup--568046008"}], "key_name": "tempest-keypair-1274343025", "user_data": "}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:14:07.007975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-844f9da4-c31c-49d5-8b33-1afd66a04afc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] validate_networks() for [('a458fb77-0452-4eef-a570-bd92e833719b', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:14:07.404431 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-844f9da4-c31c-49d5-8b33-1afd66a04afc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:14:07.405038 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-844f9da4-c31c-49d5-8b33-1afd66a04afc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:14:07.405505 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-844f9da4-c31c-49d5-8b33-1afd66a04afc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:14:07.406048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-844f9da4-c31c-49d5-8b33-1afd66a04afc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:14:07.406543 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-844f9da4-c31c-49d5-8b33-1afd66a04afc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:14:07.416482 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-844f9da4-c31c-49d5-8b33-1afd66a04afc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:07.416956 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-844f9da4-c31c-49d5-8b33-1afd66a04afc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:07.417384 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-844f9da4-c31c-49d5-8b33-1afd66a04afc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:07.418099 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-844f9da4-c31c-49d5-8b33-1afd66a04afc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:07.418566 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-844f9da4-c31c-49d5-8b33-1afd66a04afc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:07.418984 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-844f9da4-c31c-49d5-8b33-1afd66a04afc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:07.430165 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:07.437125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-844f9da4-c31c-49d5-8b33-1afd66a04afc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Getting quotas for project 62cb41eb4b8244abb4aafd718b1207ad. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:14:07.442141 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-844f9da4-c31c-49d5-8b33-1afd66a04afc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Getting quotas for user 51768890f19140b6819ef89f5bf610c8 and project 62cb41eb4b8244abb4aafd718b1207ad. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:14:07.455225 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-844f9da4-c31c-49d5-8b33-1afd66a04afc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:14:07.457701 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-844f9da4-c31c-49d5-8b33-1afd66a04afc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a2619027-0d8b-4ca3-9528-1ac3380cab5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:14:07.507952 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-844f9da4-c31c-49d5-8b33-1afd66a04afc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.635483 Sep 14 01:14:07.508589 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 475/943] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 01:14:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 01:14:07.520015 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-181918d6-97ed-4ab7-8276-627c9ccf59b3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:07.520711 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-181918d6-97ed-4ab7-8276-627c9ccf59b3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:07.579378 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-181918d6-97ed-4ab7-8276-627c9ccf59b3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:07.587133 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-181918d6-97ed-4ab7-8276-627c9ccf59b3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36" status: 200 len: 1242 microversion: 2.1 time: 0.071254 Sep 14 01:14:07.595896 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 469/944] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:07 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:14:07.596205 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-652d9e2c-4f46-4e68-be1a-8033c922ffc3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:07.596205 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-652d9e2c-4f46-4e68-be1a-8033c922ffc3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:07.601660 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-652d9e2c-4f46-4e68-be1a-8033c922ffc3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:07.603631 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-652d9e2c-4f46-4e68-be1a-8033c922ffc3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:07.604077 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-652d9e2c-4f46-4e68-be1a-8033c922ffc3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:07.605945 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-652d9e2c-4f46-4e68-be1a-8033c922ffc3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:07.606411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-652d9e2c-4f46-4e68-be1a-8033c922ffc3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:07.606840 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-652d9e2c-4f46-4e68-be1a-8033c922ffc3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:07.742649 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-652d9e2c-4f46-4e68-be1a-8033c922ffc3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:07.751026 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-652d9e2c-4f46-4e68-be1a-8033c922ffc3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:07.752552 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-652d9e2c-4f46-4e68-be1a-8033c922ffc3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:07.753715 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-652d9e2c-4f46-4e68-be1a-8033c922ffc3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.167379 Sep 14 01:14:07.754273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 476/945] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:07 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:08.610345 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ed3461bd-37ec-48cf-9419-1a03a9bcf298 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:08.610917 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ed3461bd-37ec-48cf-9419-1a03a9bcf298 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:08.622344 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ed3461bd-37ec-48cf-9419-1a03a9bcf298 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:08.622849 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ed3461bd-37ec-48cf-9419-1a03a9bcf298 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:08.623289 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ed3461bd-37ec-48cf-9419-1a03a9bcf298 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:08.624048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ed3461bd-37ec-48cf-9419-1a03a9bcf298 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:08.624504 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ed3461bd-37ec-48cf-9419-1a03a9bcf298 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:08.624931 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ed3461bd-37ec-48cf-9419-1a03a9bcf298 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:08.731347 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ed3461bd-37ec-48cf-9419-1a03a9bcf298 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:08.739282 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ed3461bd-37ec-48cf-9419-1a03a9bcf298 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36" status: 200 len: 1302 microversion: 2.1 time: 0.132878 Sep 14 01:14:08.740191 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 470/946] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:08 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 => generated 1302 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:14:08.781078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-10ef7cd7-fb0d-4d00-8e53-611df4601c19 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:08.781795 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-10ef7cd7-fb0d-4d00-8e53-611df4601c19 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:08.789609 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-10ef7cd7-fb0d-4d00-8e53-611df4601c19 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:08.790127 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-10ef7cd7-fb0d-4d00-8e53-611df4601c19 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:08.790560 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-10ef7cd7-fb0d-4d00-8e53-611df4601c19 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:08.791251 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-10ef7cd7-fb0d-4d00-8e53-611df4601c19 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:08.791746 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-10ef7cd7-fb0d-4d00-8e53-611df4601c19 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:08.792171 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-10ef7cd7-fb0d-4d00-8e53-611df4601c19 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:08.926682 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-10ef7cd7-fb0d-4d00-8e53-611df4601c19 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:08.935807 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-10ef7cd7-fb0d-4d00-8e53-611df4601c19 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:08.937340 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-10ef7cd7-fb0d-4d00-8e53-611df4601c19 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:08.938607 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-10ef7cd7-fb0d-4d00-8e53-611df4601c19 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.161597 Sep 14 01:14:08.939269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 477/947] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:08 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:09.763887 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a1093208-f73d-41bc-8b97-8e09643d8ac9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:09.764447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a1093208-f73d-41bc-8b97-8e09643d8ac9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:09.770807 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a1093208-f73d-41bc-8b97-8e09643d8ac9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:09.771293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a1093208-f73d-41bc-8b97-8e09643d8ac9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:09.771763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a1093208-f73d-41bc-8b97-8e09643d8ac9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:09.773066 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a1093208-f73d-41bc-8b97-8e09643d8ac9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:09.773779 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a1093208-f73d-41bc-8b97-8e09643d8ac9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:09.774303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a1093208-f73d-41bc-8b97-8e09643d8ac9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:09.965975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-25dd6457-8530-4430-8ae8-ee13a88f1da4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:09.966597 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-25dd6457-8530-4430-8ae8-ee13a88f1da4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:09.973551 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25dd6457-8530-4430-8ae8-ee13a88f1da4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:09.974129 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25dd6457-8530-4430-8ae8-ee13a88f1da4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:09.974683 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25dd6457-8530-4430-8ae8-ee13a88f1da4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:09.975450 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25dd6457-8530-4430-8ae8-ee13a88f1da4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:09.976449 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25dd6457-8530-4430-8ae8-ee13a88f1da4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:09.977333 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-25dd6457-8530-4430-8ae8-ee13a88f1da4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:09.979500 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a1093208-f73d-41bc-8b97-8e09643d8ac9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:09.983829 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:09.990626 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a1093208-f73d-41bc-8b97-8e09643d8ac9 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36" status: 200 len: 1367 microversion: 2.1 time: 0.230792 Sep 14 01:14:09.992310 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 471/948] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:09 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:14:10.125325 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-25dd6457-8530-4430-8ae8-ee13a88f1da4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:10.139896 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-25dd6457-8530-4430-8ae8-ee13a88f1da4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:10.141398 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-25dd6457-8530-4430-8ae8-ee13a88f1da4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:10.142580 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-25dd6457-8530-4430-8ae8-ee13a88f1da4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.180615 Sep 14 01:14:10.143141 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 478/949] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:09 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:14:10.263732 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-ea44cdfd-8d38-468b-ad31-57cad538a317 req-f5018cc3-8dbb-4905-819f-375ad2b67b17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8c88c9e-8c39-4b1a-9f75-5f49c8420a36", "tag": "79795098-660f-4059-9056-a7702e992f63"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:14:10.281756 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-ea44cdfd-8d38-468b-ad31-57cad538a317 req-f5018cc3-8dbb-4905-819f-375ad2b67b17 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:10.282243 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-ea44cdfd-8d38-468b-ad31-57cad538a317 req-f5018cc3-8dbb-4905-819f-375ad2b67b17 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:10.282673 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-ea44cdfd-8d38-468b-ad31-57cad538a317 req-f5018cc3-8dbb-4905-819f-375ad2b67b17 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:10.295804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-ea44cdfd-8d38-468b-ad31-57cad538a317 req-f5018cc3-8dbb-4905-819f-375ad2b67b17 service nova] Creating event network-changed:79795098-660f-4059-9056-a7702e992f63 for instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 on hv-cinder-85752 Sep 14 01:14:10.300774 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-ea44cdfd-8d38-468b-ad31-57cad538a317 req-f5018cc3-8dbb-4905-819f-375ad2b67b17 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040828 Sep 14 01:14:10.301499 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 472/950] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:14:11.014483 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4c6e3f0c-635e-4277-8602-edac4ae05325 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:11.015081 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4c6e3f0c-635e-4277-8602-edac4ae05325 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:11.021491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4c6e3f0c-635e-4277-8602-edac4ae05325 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:11.021968 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4c6e3f0c-635e-4277-8602-edac4ae05325 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:11.022854 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4c6e3f0c-635e-4277-8602-edac4ae05325 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:11.023569 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4c6e3f0c-635e-4277-8602-edac4ae05325 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:11.024744 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4c6e3f0c-635e-4277-8602-edac4ae05325 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:11.025321 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4c6e3f0c-635e-4277-8602-edac4ae05325 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:11.155914 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4c6e3f0c-635e-4277-8602-edac4ae05325 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:11.164005 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4c6e3f0c-635e-4277-8602-edac4ae05325 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36" status: 200 len: 1367 microversion: 2.1 time: 0.153367 Sep 14 01:14:11.164567 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 479/951] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:11 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:14:11.172457 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7ff299d9-f97f-47ea-a772-528d765a12e4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:11.173188 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7ff299d9-f97f-47ea-a772-528d765a12e4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:11.179589 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ff299d9-f97f-47ea-a772-528d765a12e4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:11.180078 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ff299d9-f97f-47ea-a772-528d765a12e4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:11.180522 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ff299d9-f97f-47ea-a772-528d765a12e4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:11.181216 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ff299d9-f97f-47ea-a772-528d765a12e4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:11.181683 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ff299d9-f97f-47ea-a772-528d765a12e4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:11.182099 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ff299d9-f97f-47ea-a772-528d765a12e4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:11.317217 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7ff299d9-f97f-47ea-a772-528d765a12e4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:11.325317 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7ff299d9-f97f-47ea-a772-528d765a12e4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:11.326764 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7ff299d9-f97f-47ea-a772-528d765a12e4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:11.327960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7ff299d9-f97f-47ea-a772-528d765a12e4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.159784 Sep 14 01:14:11.328528 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 473/952] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:11 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:12.186346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-68bfed89-e57e-49e5-9b5a-fc3672c86a32 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:12.186954 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-68bfed89-e57e-49e5-9b5a-fc3672c86a32 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:12.193482 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68bfed89-e57e-49e5-9b5a-fc3672c86a32 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:12.194000 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68bfed89-e57e-49e5-9b5a-fc3672c86a32 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:12.194707 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68bfed89-e57e-49e5-9b5a-fc3672c86a32 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:12.195394 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68bfed89-e57e-49e5-9b5a-fc3672c86a32 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:12.195872 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68bfed89-e57e-49e5-9b5a-fc3672c86a32 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:12.196293 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-68bfed89-e57e-49e5-9b5a-fc3672c86a32 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:12.327841 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-68bfed89-e57e-49e5-9b5a-fc3672c86a32 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:12.335389 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-68bfed89-e57e-49e5-9b5a-fc3672c86a32 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36" status: 200 len: 1367 microversion: 2.1 time: 0.152832 Sep 14 01:14:12.335917 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 480/953] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:12 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:14:12.354021 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0b58dce6-7ff1-4b1e-b924-e8922f0e2d41 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:12.354660 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0b58dce6-7ff1-4b1e-b924-e8922f0e2d41 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:12.360767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0b58dce6-7ff1-4b1e-b924-e8922f0e2d41 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:12.361253 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0b58dce6-7ff1-4b1e-b924-e8922f0e2d41 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:12.361688 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0b58dce6-7ff1-4b1e-b924-e8922f0e2d41 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:12.362376 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0b58dce6-7ff1-4b1e-b924-e8922f0e2d41 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:12.362828 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0b58dce6-7ff1-4b1e-b924-e8922f0e2d41 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:12.363253 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0b58dce6-7ff1-4b1e-b924-e8922f0e2d41 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:12.490457 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0b58dce6-7ff1-4b1e-b924-e8922f0e2d41 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:12.499390 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0b58dce6-7ff1-4b1e-b924-e8922f0e2d41 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:12.500871 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0b58dce6-7ff1-4b1e-b924-e8922f0e2d41 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:12.502032 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0b58dce6-7ff1-4b1e-b924-e8922f0e2d41 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.152472 Sep 14 01:14:12.502595 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 474/954] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:12 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:13.370943 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5fad3fb4-6054-4cda-bc95-a8f80d226c41 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:13.371655 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5fad3fb4-6054-4cda-bc95-a8f80d226c41 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:13.378189 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5fad3fb4-6054-4cda-bc95-a8f80d226c41 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:13.378751 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5fad3fb4-6054-4cda-bc95-a8f80d226c41 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:13.379423 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5fad3fb4-6054-4cda-bc95-a8f80d226c41 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:13.380309 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5fad3fb4-6054-4cda-bc95-a8f80d226c41 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:13.380940 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5fad3fb4-6054-4cda-bc95-a8f80d226c41 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:13.381469 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5fad3fb4-6054-4cda-bc95-a8f80d226c41 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:13.517289 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5fad3fb4-6054-4cda-bc95-a8f80d226c41 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:13.526531 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7ac1e615-5b10-4b72-a007-3be9558d7d6e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:13.527144 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7ac1e615-5b10-4b72-a007-3be9558d7d6e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:13.527267 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5fad3fb4-6054-4cda-bc95-a8f80d226c41 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36" status: 200 len: 1367 microversion: 2.1 time: 0.160336 Sep 14 01:14:13.527783 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 481/955] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:13 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:14:13.533873 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ac1e615-5b10-4b72-a007-3be9558d7d6e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:13.534363 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ac1e615-5b10-4b72-a007-3be9558d7d6e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:13.534804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ac1e615-5b10-4b72-a007-3be9558d7d6e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:13.535495 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ac1e615-5b10-4b72-a007-3be9558d7d6e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:13.536176 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ac1e615-5b10-4b72-a007-3be9558d7d6e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:13.536758 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ac1e615-5b10-4b72-a007-3be9558d7d6e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:13.740203 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7ac1e615-5b10-4b72-a007-3be9558d7d6e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:13.749524 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7ac1e615-5b10-4b72-a007-3be9558d7d6e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:13.751192 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7ac1e615-5b10-4b72-a007-3be9558d7d6e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:13.752369 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7ac1e615-5b10-4b72-a007-3be9558d7d6e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1746 microversion: 2.20 time: 0.229761 Sep 14 01:14:13.752935 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 475/956] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:13 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1746 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:14.381295 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-feb7e77e-f2ee-4236-9b9a-4855315374c9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:14.382521 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-feb7e77e-f2ee-4236-9b9a-4855315374c9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:14.388981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-feb7e77e-f2ee-4236-9b9a-4855315374c9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:14.389398 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-feb7e77e-f2ee-4236-9b9a-4855315374c9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:14.389896 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-feb7e77e-f2ee-4236-9b9a-4855315374c9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:14.390593 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-feb7e77e-f2ee-4236-9b9a-4855315374c9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:14.391051 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-feb7e77e-f2ee-4236-9b9a-4855315374c9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:14.391476 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-feb7e77e-f2ee-4236-9b9a-4855315374c9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:14.524264 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-feb7e77e-f2ee-4236-9b9a-4855315374c9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:14.532282 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-feb7e77e-f2ee-4236-9b9a-4855315374c9 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1594 microversion: 2.1 time: 0.154843 Sep 14 01:14:14.532844 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 482/957] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:14 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:14:14.549407 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-3a7c2111-1b9b-4560-a648-aa223f92f03c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:14.550025 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-3a7c2111-1b9b-4560-a648-aa223f92f03c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:14.551995 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=2 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:14.558942 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3a7c2111-1b9b-4560-a648-aa223f92f03c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:14.559434 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3a7c2111-1b9b-4560-a648-aa223f92f03c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:14.559898 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3a7c2111-1b9b-4560-a648-aa223f92f03c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:14.560596 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3a7c2111-1b9b-4560-a648-aa223f92f03c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:14.561050 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3a7c2111-1b9b-4560-a648-aa223f92f03c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:14.561474 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3a7c2111-1b9b-4560-a648-aa223f92f03c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:14.720128 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-3a7c2111-1b9b-4560-a648-aa223f92f03c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:14.729006 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-3a7c2111-1b9b-4560-a648-aa223f92f03c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36" status: 200 len: 1367 microversion: 2.1 time: 0.183292 Sep 14 01:14:14.729788 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 476/958] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:14 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:14:14.778473 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7db635ba-8984-4774-a732-594c65322481 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:14.779084 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7db635ba-8984-4774-a732-594c65322481 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:14.784986 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7db635ba-8984-4774-a732-594c65322481 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:14.785466 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7db635ba-8984-4774-a732-594c65322481 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:14.785895 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7db635ba-8984-4774-a732-594c65322481 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:14.786580 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7db635ba-8984-4774-a732-594c65322481 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:14.787030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7db635ba-8984-4774-a732-594c65322481 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:14.787452 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7db635ba-8984-4774-a732-594c65322481 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:15.008915 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7db635ba-8984-4774-a732-594c65322481 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:15.018295 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7db635ba-8984-4774-a732-594c65322481 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:15.019954 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7db635ba-8984-4774-a732-594c65322481 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:15.021117 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7db635ba-8984-4774-a732-594c65322481 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1746 microversion: 2.20 time: 0.246596 Sep 14 01:14:15.021663 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 483/959] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:14 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1746 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:15.125251 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-d54da816-8761-4bce-9567-e666d887ec9f req-c28e39fa-7c77-49be-bffa-1cb79ca609a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291f27aa-9e42-4937-be7d-5e849d90e611", "name": "network-vif-plugged", "status": "completed", "tag": "5a0c8ef2-8392-47a2-bf1c-1530912083d1"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:14:15.135936 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-d54da816-8761-4bce-9567-e666d887ec9f req-c28e39fa-7c77-49be-bffa-1cb79ca609a6 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:15.136550 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-d54da816-8761-4bce-9567-e666d887ec9f req-c28e39fa-7c77-49be-bffa-1cb79ca609a6 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:15.137273 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-d54da816-8761-4bce-9567-e666d887ec9f req-c28e39fa-7c77-49be-bffa-1cb79ca609a6 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:15.151365 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-d54da816-8761-4bce-9567-e666d887ec9f req-c28e39fa-7c77-49be-bffa-1cb79ca609a6 service nova] Creating event network-vif-plugged:5a0c8ef2-8392-47a2-bf1c-1530912083d1 for instance 291f27aa-9e42-4937-be7d-5e849d90e611 on hv-cinder-85752 Sep 14 01:14:15.158525 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-d54da816-8761-4bce-9567-e666d887ec9f req-c28e39fa-7c77-49be-bffa-1cb79ca609a6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035874 Sep 14 01:14:15.159126 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 477/960] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:14:15.751898 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5ad41bc4-06ee-40c1-a7e4-404886be79b8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:15.752458 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5ad41bc4-06ee-40c1-a7e4-404886be79b8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:15.760413 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ad41bc4-06ee-40c1-a7e4-404886be79b8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:15.760896 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ad41bc4-06ee-40c1-a7e4-404886be79b8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:15.761324 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ad41bc4-06ee-40c1-a7e4-404886be79b8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:15.762022 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ad41bc4-06ee-40c1-a7e4-404886be79b8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:15.762471 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ad41bc4-06ee-40c1-a7e4-404886be79b8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:15.762890 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ad41bc4-06ee-40c1-a7e4-404886be79b8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:15.974261 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5ad41bc4-06ee-40c1-a7e4-404886be79b8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:15.982853 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5ad41bc4-06ee-40c1-a7e4-404886be79b8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36" status: 200 len: 1367 microversion: 2.1 time: 0.234962 Sep 14 01:14:15.983513 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 484/961] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:15 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:14:16.046975 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-bff136c1-c04d-470f-9996-29dfe4b3176a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:16.047591 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-bff136c1-c04d-470f-9996-29dfe4b3176a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:16.055146 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bff136c1-c04d-470f-9996-29dfe4b3176a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:16.055696 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bff136c1-c04d-470f-9996-29dfe4b3176a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:16.056137 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bff136c1-c04d-470f-9996-29dfe4b3176a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:16.056866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bff136c1-c04d-470f-9996-29dfe4b3176a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:16.057453 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bff136c1-c04d-470f-9996-29dfe4b3176a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:16.057886 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bff136c1-c04d-470f-9996-29dfe4b3176a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:16.191065 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bff136c1-c04d-470f-9996-29dfe4b3176a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:16.200313 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bff136c1-c04d-470f-9996-29dfe4b3176a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:16.202571 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bff136c1-c04d-470f-9996-29dfe4b3176a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:16.203777 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-bff136c1-c04d-470f-9996-29dfe4b3176a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1746 microversion: 2.20 time: 0.161228 Sep 14 01:14:16.204832 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 478/962] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:16 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:14:16.663354 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-20b060c2-d1a0-41ec-a1dc-b4d2986775ed req-5c9983bb-b390-4265-8e13-32631d772a70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c532d078-01eb-4150-8869-3c33a457898c", "tag": "78292043-7571-4bbd-b478-4125b485b189"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:14:16.673333 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-20b060c2-d1a0-41ec-a1dc-b4d2986775ed req-5c9983bb-b390-4265-8e13-32631d772a70 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:16.673813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-20b060c2-d1a0-41ec-a1dc-b4d2986775ed req-5c9983bb-b390-4265-8e13-32631d772a70 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:16.674237 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-20b060c2-d1a0-41ec-a1dc-b4d2986775ed req-5c9983bb-b390-4265-8e13-32631d772a70 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:16.688003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-20b060c2-d1a0-41ec-a1dc-b4d2986775ed req-5c9983bb-b390-4265-8e13-32631d772a70 service nova] Creating event network-changed:78292043-7571-4bbd-b478-4125b485b189 for instance c532d078-01eb-4150-8869-3c33a457898c on hv-cinder-85752 Sep 14 01:14:16.694663 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-20b060c2-d1a0-41ec-a1dc-b4d2986775ed req-5c9983bb-b390-4265-8e13-32631d772a70 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034796 Sep 14 01:14:16.695593 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 485/963] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:14:17.006961 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-f2d9de0a-4d0e-4d18-93b3-10ee5cd667f6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:17.007599 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-f2d9de0a-4d0e-4d18-93b3-10ee5cd667f6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:17.013945 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f2d9de0a-4d0e-4d18-93b3-10ee5cd667f6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:17.014683 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f2d9de0a-4d0e-4d18-93b3-10ee5cd667f6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:17.015308 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f2d9de0a-4d0e-4d18-93b3-10ee5cd667f6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:17.016197 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f2d9de0a-4d0e-4d18-93b3-10ee5cd667f6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:17.016817 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f2d9de0a-4d0e-4d18-93b3-10ee5cd667f6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:17.017405 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f2d9de0a-4d0e-4d18-93b3-10ee5cd667f6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:17.175434 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-a16a5240-e261-4841-a15f-e8f66b552b5f req-d2a0ad2b-885a-4bbb-a547-8bcc3d007656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8c88c9e-8c39-4b1a-9f75-5f49c8420a36", "name": "network-vif-plugged", "status": "completed", "tag": "79795098-660f-4059-9056-a7702e992f63"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:14:17.190642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-a16a5240-e261-4841-a15f-e8f66b552b5f req-d2a0ad2b-885a-4bbb-a547-8bcc3d007656 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:17.191172 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-a16a5240-e261-4841-a15f-e8f66b552b5f req-d2a0ad2b-885a-4bbb-a547-8bcc3d007656 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:17.191618 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-a16a5240-e261-4841-a15f-e8f66b552b5f req-d2a0ad2b-885a-4bbb-a547-8bcc3d007656 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:17.294409 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-f2d9de0a-4d0e-4d18-93b3-10ee5cd667f6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:17.314336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-f2d9de0a-4d0e-4d18-93b3-10ee5cd667f6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36" status: 200 len: 1367 microversion: 2.1 time: 0.311677 Sep 14 01:14:17.334813 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 479/964] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:17 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:14:17.342016 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9db22699-39b6-4b19-b696-de7cd033bc65 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:17.343303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9db22699-39b6-4b19-b696-de7cd033bc65 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:17.358835 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9db22699-39b6-4b19-b696-de7cd033bc65 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:17.361225 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9db22699-39b6-4b19-b696-de7cd033bc65 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:17.362206 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9db22699-39b6-4b19-b696-de7cd033bc65 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:17.363466 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9db22699-39b6-4b19-b696-de7cd033bc65 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:17.364124 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9db22699-39b6-4b19-b696-de7cd033bc65 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:17.364841 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9db22699-39b6-4b19-b696-de7cd033bc65 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:17.373156 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-a16a5240-e261-4841-a15f-e8f66b552b5f req-d2a0ad2b-885a-4bbb-a547-8bcc3d007656 service nova] Creating event network-vif-plugged:79795098-660f-4059-9056-a7702e992f63 for instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 on hv-cinder-85752 Sep 14 01:14:17.380143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-a16a5240-e261-4841-a15f-e8f66b552b5f req-d2a0ad2b-885a-4bbb-a547-8bcc3d007656 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208578 Sep 14 01:14:17.381259 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 486/965] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:14:17.586921 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=6 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:17.603776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9db22699-39b6-4b19-b696-de7cd033bc65 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:17.613101 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9db22699-39b6-4b19-b696-de7cd033bc65 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:17.615110 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9db22699-39b6-4b19-b696-de7cd033bc65 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:17.616911 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9db22699-39b6-4b19-b696-de7cd033bc65 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1746 microversion: 2.20 time: 0.280362 Sep 14 01:14:17.617473 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 480/966] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:17 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1746 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:17.885784 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:17.886636 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=6 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:17.890875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6a7d9c53-f1de-446a-a3f8-7007069348e2 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1863250861"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:14:17.892567 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6a7d9c53-f1de-446a-a3f8-7007069348e2 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:17.900430 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6a7d9c53-f1de-446a-a3f8-7007069348e2 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:17.900924 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6a7d9c53-f1de-446a-a3f8-7007069348e2 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:17.901360 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6a7d9c53-f1de-446a-a3f8-7007069348e2 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:17.902059 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6a7d9c53-f1de-446a-a3f8-7007069348e2 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:17.902521 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6a7d9c53-f1de-446a-a3f8-7007069348e2 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:17.902948 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6a7d9c53-f1de-446a-a3f8-7007069348e2 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:18.033996 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.network.security_group_api [None req-6a7d9c53-f1de-446a-a3f8-7007069348e2 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Adding security group 6b31a37d-28bd-4092-9d76-f4964a59a1e9 to port 78292043-7571-4bbd-b478-4125b485b189 Sep 14 01:14:18.341620 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7c551dd6-9aee-4236-b1eb-29501c3679a8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:18.342252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7c551dd6-9aee-4236-b1eb-29501c3679a8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:18.348804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7c551dd6-9aee-4236-b1eb-29501c3679a8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:18.349300 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7c551dd6-9aee-4236-b1eb-29501c3679a8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:18.349773 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7c551dd6-9aee-4236-b1eb-29501c3679a8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:18.350680 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7c551dd6-9aee-4236-b1eb-29501c3679a8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:18.351142 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7c551dd6-9aee-4236-b1eb-29501c3679a8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:18.351591 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7c551dd6-9aee-4236-b1eb-29501c3679a8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:18.351888 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6a7d9c53-f1de-446a-a3f8-7007069348e2 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "POST /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/action" status: 202 len: 0 microversion: 2.1 time: 0.466809 Sep 14 01:14:18.352766 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 487/967] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 01:14:17 2022] POST /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:14:18.360439 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-536e0809-23e6-4a51-b0d4-68ace98b8987 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:18.361049 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-536e0809-23e6-4a51-b0d4-68ace98b8987 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:18.367109 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-536e0809-23e6-4a51-b0d4-68ace98b8987 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:18.367692 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-536e0809-23e6-4a51-b0d4-68ace98b8987 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:18.368077 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-536e0809-23e6-4a51-b0d4-68ace98b8987 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:18.368771 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-536e0809-23e6-4a51-b0d4-68ace98b8987 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:18.369237 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-536e0809-23e6-4a51-b0d4-68ace98b8987 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:18.369675 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-536e0809-23e6-4a51-b0d4-68ace98b8987 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:18.560708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-536e0809-23e6-4a51-b0d4-68ace98b8987 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:18.570934 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-536e0809-23e6-4a51-b0d4-68ace98b8987 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1759 microversion: 2.1 time: 0.214032 Sep 14 01:14:18.571511 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 488/968] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:18 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1759 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:14:18.647217 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1cbf0132-e0d6-4fc0-9544-5d68af26e3e3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:18.648163 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1cbf0132-e0d6-4fc0-9544-5d68af26e3e3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:18.655121 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1cbf0132-e0d6-4fc0-9544-5d68af26e3e3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:18.656260 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1cbf0132-e0d6-4fc0-9544-5d68af26e3e3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:18.656758 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1cbf0132-e0d6-4fc0-9544-5d68af26e3e3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:18.657472 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1cbf0132-e0d6-4fc0-9544-5d68af26e3e3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:18.657926 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1cbf0132-e0d6-4fc0-9544-5d68af26e3e3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:18.658349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1cbf0132-e0d6-4fc0-9544-5d68af26e3e3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:18.753817 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7c551dd6-9aee-4236-b1eb-29501c3679a8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:18.763350 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7c551dd6-9aee-4236-b1eb-29501c3679a8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36" status: 200 len: 1367 microversion: 2.1 time: 0.425563 Sep 14 01:14:18.775987 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 481/969] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:18 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 => generated 1367 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:14:18.785446 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-c1a83896-a0d6-4abe-ae25-1c54b4fba6fc req-8e912ed6-4883-4010-8f6c-3d7fd071fd19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c532d078-01eb-4150-8869-3c33a457898c", "tag": "78292043-7571-4bbd-b478-4125b485b189"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:14:18.796550 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-c1a83896-a0d6-4abe-ae25-1c54b4fba6fc req-8e912ed6-4883-4010-8f6c-3d7fd071fd19 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:18.797252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-c1a83896-a0d6-4abe-ae25-1c54b4fba6fc req-8e912ed6-4883-4010-8f6c-3d7fd071fd19 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:18.797830 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-c1a83896-a0d6-4abe-ae25-1c54b4fba6fc req-8e912ed6-4883-4010-8f6c-3d7fd071fd19 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:18.809815 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-c1a83896-a0d6-4abe-ae25-1c54b4fba6fc req-8e912ed6-4883-4010-8f6c-3d7fd071fd19 service nova] Creating event network-changed:78292043-7571-4bbd-b478-4125b485b189 for instance c532d078-01eb-4150-8869-3c33a457898c on hv-cinder-85752 Sep 14 01:14:18.816036 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-c1a83896-a0d6-4abe-ae25-1c54b4fba6fc req-8e912ed6-4883-4010-8f6c-3d7fd071fd19 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037982 Sep 14 01:14:18.816813 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 482/970] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:14:18.822799 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1cbf0132-e0d6-4fc0-9544-5d68af26e3e3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:18.832630 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1cbf0132-e0d6-4fc0-9544-5d68af26e3e3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:18.834068 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1cbf0132-e0d6-4fc0-9544-5d68af26e3e3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:18.836154 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1cbf0132-e0d6-4fc0-9544-5d68af26e3e3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1746 microversion: 2.20 time: 0.195338 Sep 14 01:14:18.836698 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 489/971] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:18 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1746 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:19.792710 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-60226ec9-0ada-4dad-ba95-c0dd5a43664f tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:19.793334 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-60226ec9-0ada-4dad-ba95-c0dd5a43664f tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:19.800022 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-60226ec9-0ada-4dad-ba95-c0dd5a43664f tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:19.800510 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-60226ec9-0ada-4dad-ba95-c0dd5a43664f tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:19.800951 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-60226ec9-0ada-4dad-ba95-c0dd5a43664f tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:19.801644 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-60226ec9-0ada-4dad-ba95-c0dd5a43664f tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:19.802104 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-60226ec9-0ada-4dad-ba95-c0dd5a43664f tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:19.802533 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-60226ec9-0ada-4dad-ba95-c0dd5a43664f tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:19.861892 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5ccbd308-09cc-40b5-bf8c-1fbe22660898 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:19.863105 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5ccbd308-09cc-40b5-bf8c-1fbe22660898 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:19.869989 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ccbd308-09cc-40b5-bf8c-1fbe22660898 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:19.870499 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ccbd308-09cc-40b5-bf8c-1fbe22660898 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:19.870935 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ccbd308-09cc-40b5-bf8c-1fbe22660898 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:19.873079 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ccbd308-09cc-40b5-bf8c-1fbe22660898 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:19.873543 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ccbd308-09cc-40b5-bf8c-1fbe22660898 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:19.873969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5ccbd308-09cc-40b5-bf8c-1fbe22660898 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:19.936750 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-60226ec9-0ada-4dad-ba95-c0dd5a43664f tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:19.944475 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-60226ec9-0ada-4dad-ba95-c0dd5a43664f tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36" status: 200 len: 1558 microversion: 2.1 time: 0.156066 Sep 14 01:14:19.945040 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 483/972] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:14:19 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:14:19.966733 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-aaf7ef30-e70c-45c3-b815-6a3eac84f3e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:19.967280 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-aaf7ef30-e70c-45c3-b815-6a3eac84f3e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:19.973681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aaf7ef30-e70c-45c3-b815-6a3eac84f3e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:19.973681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aaf7ef30-e70c-45c3-b815-6a3eac84f3e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:19.974106 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aaf7ef30-e70c-45c3-b815-6a3eac84f3e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:19.975385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aaf7ef30-e70c-45c3-b815-6a3eac84f3e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:19.975878 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aaf7ef30-e70c-45c3-b815-6a3eac84f3e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:19.976311 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aaf7ef30-e70c-45c3-b815-6a3eac84f3e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:20.004514 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5ccbd308-09cc-40b5-bf8c-1fbe22660898 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:20.013331 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5ccbd308-09cc-40b5-bf8c-1fbe22660898 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:20.016187 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5ccbd308-09cc-40b5-bf8c-1fbe22660898 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:20.016187 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5ccbd308-09cc-40b5-bf8c-1fbe22660898 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1746 microversion: 2.20 time: 0.158230 Sep 14 01:14:20.016729 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 490/973] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:19 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:20.055016 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-aaf7ef30-e70c-45c3-b815-6a3eac84f3e5 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092194 Sep 14 01:14:20.055684 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 484/974] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Sep 14 01:14:19 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:14:21.043521 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d77deafc-55b3-4563-bba8-f72af558190a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:21.044244 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d77deafc-55b3-4563-bba8-f72af558190a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:21.055645 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d77deafc-55b3-4563-bba8-f72af558190a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:21.056143 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d77deafc-55b3-4563-bba8-f72af558190a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:21.064449 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d77deafc-55b3-4563-bba8-f72af558190a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:21.065432 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d77deafc-55b3-4563-bba8-f72af558190a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:21.068055 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d77deafc-55b3-4563-bba8-f72af558190a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:21.068832 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d77deafc-55b3-4563-bba8-f72af558190a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:21.104629 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-a03fe08f-c205-4610-8bda-58fcc4e3c87b req-53e16afd-d46e-40e2-9eb7-6d6bcdfa54e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8c88c9e-8c39-4b1a-9f75-5f49c8420a36", "tag": "79795098-660f-4059-9056-a7702e992f63"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:14:21.114471 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-a03fe08f-c205-4610-8bda-58fcc4e3c87b req-53e16afd-d46e-40e2-9eb7-6d6bcdfa54e5 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:21.115288 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-a03fe08f-c205-4610-8bda-58fcc4e3c87b req-53e16afd-d46e-40e2-9eb7-6d6bcdfa54e5 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:21.116152 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-a03fe08f-c205-4610-8bda-58fcc4e3c87b req-53e16afd-d46e-40e2-9eb7-6d6bcdfa54e5 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:21.136524 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-a03fe08f-c205-4610-8bda-58fcc4e3c87b req-53e16afd-d46e-40e2-9eb7-6d6bcdfa54e5 service nova] Creating event network-changed:79795098-660f-4059-9056-a7702e992f63 for instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 on hv-cinder-85752 Sep 14 01:14:21.142600 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-a03fe08f-c205-4610-8bda-58fcc4e3c87b req-53e16afd-d46e-40e2-9eb7-6d6bcdfa54e5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043054 Sep 14 01:14:21.143719 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 485/975] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:14:21.313241 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d77deafc-55b3-4563-bba8-f72af558190a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:21.324968 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d77deafc-55b3-4563-bba8-f72af558190a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:21.327315 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d77deafc-55b3-4563-bba8-f72af558190a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:21.329512 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d77deafc-55b3-4563-bba8-f72af558190a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1741 microversion: 2.20 time: 0.288994 Sep 14 01:14:21.366022 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 491/976] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:21 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1741 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:22.372830 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-bbafefc5-48d1-4c55-a12f-9ebb4d76f989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:22.374173 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-bbafefc5-48d1-4c55-a12f-9ebb4d76f989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:22.380565 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bbafefc5-48d1-4c55-a12f-9ebb4d76f989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:22.383203 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bbafefc5-48d1-4c55-a12f-9ebb4d76f989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:22.383910 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bbafefc5-48d1-4c55-a12f-9ebb4d76f989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:22.384673 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bbafefc5-48d1-4c55-a12f-9ebb4d76f989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:22.385115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bbafefc5-48d1-4c55-a12f-9ebb4d76f989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:22.385704 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bbafefc5-48d1-4c55-a12f-9ebb4d76f989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:22.563105 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bbafefc5-48d1-4c55-a12f-9ebb4d76f989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:22.575174 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bbafefc5-48d1-4c55-a12f-9ebb4d76f989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:22.576706 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bbafefc5-48d1-4c55-a12f-9ebb4d76f989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:22.577899 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-bbafefc5-48d1-4c55-a12f-9ebb4d76f989 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1741 microversion: 2.20 time: 0.210551 Sep 14 01:14:22.578643 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 486/977] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:22 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1741 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:23.608528 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-23a6f9b3-24e4-47da-8bd3-eb3ff4d356c4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:23.609194 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-23a6f9b3-24e4-47da-8bd3-eb3ff4d356c4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:23.617041 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-23a6f9b3-24e4-47da-8bd3-eb3ff4d356c4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:23.617524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-23a6f9b3-24e4-47da-8bd3-eb3ff4d356c4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:23.617952 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-23a6f9b3-24e4-47da-8bd3-eb3ff4d356c4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:23.618638 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-23a6f9b3-24e4-47da-8bd3-eb3ff4d356c4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:23.619086 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-23a6f9b3-24e4-47da-8bd3-eb3ff4d356c4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:23.619509 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-23a6f9b3-24e4-47da-8bd3-eb3ff4d356c4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:23.762750 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-23a6f9b3-24e4-47da-8bd3-eb3ff4d356c4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:23.771200 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-23a6f9b3-24e4-47da-8bd3-eb3ff4d356c4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:23.773088 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-23a6f9b3-24e4-47da-8bd3-eb3ff4d356c4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:23.774523 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-23a6f9b3-24e4-47da-8bd3-eb3ff4d356c4 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1741 microversion: 2.20 time: 0.170156 Sep 14 01:14:23.775692 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 492/978] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:23 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:24.800707 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-509fb460-7201-4448-8109-08ee6bb1118d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:24.801466 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-509fb460-7201-4448-8109-08ee6bb1118d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:24.808529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-509fb460-7201-4448-8109-08ee6bb1118d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:24.809008 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-509fb460-7201-4448-8109-08ee6bb1118d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:24.809442 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-509fb460-7201-4448-8109-08ee6bb1118d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:24.810130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-509fb460-7201-4448-8109-08ee6bb1118d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:24.810578 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-509fb460-7201-4448-8109-08ee6bb1118d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:24.810994 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-509fb460-7201-4448-8109-08ee6bb1118d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:24.957089 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-509fb460-7201-4448-8109-08ee6bb1118d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:24.965863 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-509fb460-7201-4448-8109-08ee6bb1118d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:24.967541 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-509fb460-7201-4448-8109-08ee6bb1118d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:24.968735 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-509fb460-7201-4448-8109-08ee6bb1118d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1741 microversion: 2.20 time: 0.171909 Sep 14 01:14:24.969303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 487/979] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:24 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:14:25.998071 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7bbe6e8f-34fe-4880-8e12-79c34273e1cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:25.999415 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7bbe6e8f-34fe-4880-8e12-79c34273e1cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:26.007486 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bbe6e8f-34fe-4880-8e12-79c34273e1cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:26.008285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bbe6e8f-34fe-4880-8e12-79c34273e1cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:26.008913 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bbe6e8f-34fe-4880-8e12-79c34273e1cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:26.009618 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bbe6e8f-34fe-4880-8e12-79c34273e1cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:26.010078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bbe6e8f-34fe-4880-8e12-79c34273e1cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:26.010640 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7bbe6e8f-34fe-4880-8e12-79c34273e1cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:26.015070 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:26.159136 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7bbe6e8f-34fe-4880-8e12-79c34273e1cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:26.168199 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7bbe6e8f-34fe-4880-8e12-79c34273e1cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:26.169651 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7bbe6e8f-34fe-4880-8e12-79c34273e1cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:26.171014 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7bbe6e8f-34fe-4880-8e12-79c34273e1cf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1741 microversion: 2.20 time: 0.176650 Sep 14 01:14:26.171785 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 493/980] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:25 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:27.198440 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-46d73dfc-dc50-486c-a360-227e2b96f714 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:27.199278 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-46d73dfc-dc50-486c-a360-227e2b96f714 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:27.207850 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-46d73dfc-dc50-486c-a360-227e2b96f714 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:27.208757 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-46d73dfc-dc50-486c-a360-227e2b96f714 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:27.209803 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-46d73dfc-dc50-486c-a360-227e2b96f714 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:27.211639 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-46d73dfc-dc50-486c-a360-227e2b96f714 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:27.213155 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-46d73dfc-dc50-486c-a360-227e2b96f714 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:27.213668 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-46d73dfc-dc50-486c-a360-227e2b96f714 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:27.375449 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-46d73dfc-dc50-486c-a360-227e2b96f714 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:27.386136 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-46d73dfc-dc50-486c-a360-227e2b96f714 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:27.387660 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-46d73dfc-dc50-486c-a360-227e2b96f714 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:27.388827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-46d73dfc-dc50-486c-a360-227e2b96f714 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1741 microversion: 2.20 time: 0.195491 Sep 14 01:14:27.403579 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 488/981] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:27 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:28.417891 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9ebfef45-6aef-4cee-82df-74b440df4b0d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:28.418578 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9ebfef45-6aef-4cee-82df-74b440df4b0d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:28.426375 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9ebfef45-6aef-4cee-82df-74b440df4b0d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:28.426870 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9ebfef45-6aef-4cee-82df-74b440df4b0d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:28.427307 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9ebfef45-6aef-4cee-82df-74b440df4b0d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:28.428101 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9ebfef45-6aef-4cee-82df-74b440df4b0d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:28.428562 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9ebfef45-6aef-4cee-82df-74b440df4b0d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:28.428993 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9ebfef45-6aef-4cee-82df-74b440df4b0d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:28.593607 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9ebfef45-6aef-4cee-82df-74b440df4b0d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:28.604439 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9ebfef45-6aef-4cee-82df-74b440df4b0d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:28.605879 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9ebfef45-6aef-4cee-82df-74b440df4b0d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:28.607039 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9ebfef45-6aef-4cee-82df-74b440df4b0d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1741 microversion: 2.20 time: 0.194231 Sep 14 01:14:28.607609 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 494/982] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:28 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1741 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:29.634121 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8c21adc5-71ea-439d-8ae7-0991ceb84395 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:29.635281 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8c21adc5-71ea-439d-8ae7-0991ceb84395 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:29.643051 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c21adc5-71ea-439d-8ae7-0991ceb84395 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:29.644022 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c21adc5-71ea-439d-8ae7-0991ceb84395 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:29.644915 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c21adc5-71ea-439d-8ae7-0991ceb84395 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:29.646100 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c21adc5-71ea-439d-8ae7-0991ceb84395 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:29.646910 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c21adc5-71ea-439d-8ae7-0991ceb84395 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:29.647399 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c21adc5-71ea-439d-8ae7-0991ceb84395 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:29.794361 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8c21adc5-71ea-439d-8ae7-0991ceb84395 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:29.803283 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8c21adc5-71ea-439d-8ae7-0991ceb84395 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:29.805340 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8c21adc5-71ea-439d-8ae7-0991ceb84395 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:29.806541 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8c21adc5-71ea-439d-8ae7-0991ceb84395 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1741 microversion: 2.20 time: 0.176946 Sep 14 01:14:29.807336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 489/983] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:29 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:30.844042 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ea3ea917-d516-4a59-96c7-51e2b5911de6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:30.844563 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ea3ea917-d516-4a59-96c7-51e2b5911de6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:30.852338 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ea3ea917-d516-4a59-96c7-51e2b5911de6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:30.852819 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ea3ea917-d516-4a59-96c7-51e2b5911de6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:30.853253 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ea3ea917-d516-4a59-96c7-51e2b5911de6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:30.853936 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ea3ea917-d516-4a59-96c7-51e2b5911de6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:30.854387 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ea3ea917-d516-4a59-96c7-51e2b5911de6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:30.854811 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ea3ea917-d516-4a59-96c7-51e2b5911de6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:30.985516 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ea3ea917-d516-4a59-96c7-51e2b5911de6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:30.994038 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ea3ea917-d516-4a59-96c7-51e2b5911de6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:30.995473 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ea3ea917-d516-4a59-96c7-51e2b5911de6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:30.996703 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ea3ea917-d516-4a59-96c7-51e2b5911de6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1741 microversion: 2.20 time: 0.156626 Sep 14 01:14:30.997274 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 495/984] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:30 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:32.022946 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-51e21b14-ab9f-4958-8a30-1a7e62809d39 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:32.023543 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-51e21b14-ab9f-4958-8a30-1a7e62809d39 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:32.029947 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-51e21b14-ab9f-4958-8a30-1a7e62809d39 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:32.030430 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-51e21b14-ab9f-4958-8a30-1a7e62809d39 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:32.030861 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-51e21b14-ab9f-4958-8a30-1a7e62809d39 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:32.031563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-51e21b14-ab9f-4958-8a30-1a7e62809d39 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:32.032025 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-51e21b14-ab9f-4958-8a30-1a7e62809d39 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:32.032447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-51e21b14-ab9f-4958-8a30-1a7e62809d39 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:32.163020 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-51e21b14-ab9f-4958-8a30-1a7e62809d39 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:32.170905 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-51e21b14-ab9f-4958-8a30-1a7e62809d39 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:32.172360 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-51e21b14-ab9f-4958-8a30-1a7e62809d39 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:32.173496 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-51e21b14-ab9f-4958-8a30-1a7e62809d39 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1723 microversion: 2.20 time: 0.154584 Sep 14 01:14:32.174048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 490/985] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:32 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:33.199604 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7c3e1c6e-8547-483a-a2a0-c24b26f2a80d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:33.200219 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7c3e1c6e-8547-483a-a2a0-c24b26f2a80d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:33.206640 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c3e1c6e-8547-483a-a2a0-c24b26f2a80d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:33.207128 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c3e1c6e-8547-483a-a2a0-c24b26f2a80d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:33.207577 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c3e1c6e-8547-483a-a2a0-c24b26f2a80d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:33.208280 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c3e1c6e-8547-483a-a2a0-c24b26f2a80d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:33.209374 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c3e1c6e-8547-483a-a2a0-c24b26f2a80d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:33.209800 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7c3e1c6e-8547-483a-a2a0-c24b26f2a80d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:33.340983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7c3e1c6e-8547-483a-a2a0-c24b26f2a80d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:33.349193 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7c3e1c6e-8547-483a-a2a0-c24b26f2a80d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:33.350643 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7c3e1c6e-8547-483a-a2a0-c24b26f2a80d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:33.351872 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7c3e1c6e-8547-483a-a2a0-c24b26f2a80d tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1723 microversion: 2.20 time: 0.156154 Sep 14 01:14:33.352364 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 496/986] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:33 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:33.359129 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-f504824e-8a8d-48ce-bc79-d93ad25264fa req-5809acc6-1a63-496f-b791-ac442c312940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291f27aa-9e42-4937-be7d-5e849d90e611", "name": "network-vif-unplugged", "status": "completed", "tag": "5a0c8ef2-8392-47a2-bf1c-1530912083d1"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:14:33.369689 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-f504824e-8a8d-48ce-bc79-d93ad25264fa req-5809acc6-1a63-496f-b791-ac442c312940 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:33.370554 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-f504824e-8a8d-48ce-bc79-d93ad25264fa req-5809acc6-1a63-496f-b791-ac442c312940 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:33.371152 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-f504824e-8a8d-48ce-bc79-d93ad25264fa req-5809acc6-1a63-496f-b791-ac442c312940 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:33.387117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-f504824e-8a8d-48ce-bc79-d93ad25264fa req-5809acc6-1a63-496f-b791-ac442c312940 service nova] Creating event network-vif-unplugged:5a0c8ef2-8392-47a2-bf1c-1530912083d1 for instance 291f27aa-9e42-4937-be7d-5e849d90e611 on hv-cinder-85752 Sep 14 01:14:33.392195 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-f504824e-8a8d-48ce-bc79-d93ad25264fa req-5809acc6-1a63-496f-b791-ac442c312940 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036868 Sep 14 01:14:33.392789 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 491/987] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:14:34.377466 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5fa6c09a-deac-4f78-be8f-2dc63a6403fe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:34.378058 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5fa6c09a-deac-4f78-be8f-2dc63a6403fe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:34.385082 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5fa6c09a-deac-4f78-be8f-2dc63a6403fe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:34.385579 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5fa6c09a-deac-4f78-be8f-2dc63a6403fe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:34.386045 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5fa6c09a-deac-4f78-be8f-2dc63a6403fe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:34.386741 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5fa6c09a-deac-4f78-be8f-2dc63a6403fe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:34.387194 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5fa6c09a-deac-4f78-be8f-2dc63a6403fe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:34.387678 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5fa6c09a-deac-4f78-be8f-2dc63a6403fe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:34.519633 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5fa6c09a-deac-4f78-be8f-2dc63a6403fe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:34.528273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5fa6c09a-deac-4f78-be8f-2dc63a6403fe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:34.529713 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5fa6c09a-deac-4f78-be8f-2dc63a6403fe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:34.530856 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5fa6c09a-deac-4f78-be8f-2dc63a6403fe tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1666 microversion: 2.20 time: 0.157673 Sep 14 01:14:34.531405 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 497/988] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:34 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:34.557023 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7d3e987b-7186-4399-acd6-eae2f66d6f79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58f6e317-259f-4f57-89c0-7dfa3322648a"}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:14:34.559509 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7d3e987b-7186-4399-acd6-eae2f66d6f79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:34.565547 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7d3e987b-7186-4399-acd6-eae2f66d6f79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:34.566059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7d3e987b-7186-4399-acd6-eae2f66d6f79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:34.566494 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7d3e987b-7186-4399-acd6-eae2f66d6f79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:34.567177 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7d3e987b-7186-4399-acd6-eae2f66d6f79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:34.567735 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7d3e987b-7186-4399-acd6-eae2f66d6f79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:34.568769 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7d3e987b-7186-4399-acd6-eae2f66d6f79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:34.572489 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=100 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:34.842860 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7d3e987b-7186-4399-acd6-eae2f66d6f79 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "POST /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.291350 Sep 14 01:14:34.843457 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 492/989] 10.222.0.42 () {62 vars in 1364 bytes} [Wed Sep 14 01:14:34 2022] POST /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611/os-volume_attachments => generated 188 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 01:14:34.966635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b31e4b4e-4044-4f88-ac68-353c9c13ddba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:34.967134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b31e4b4e-4044-4f88-ac68-353c9c13ddba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:34.973012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b31e4b4e-4044-4f88-ac68-353c9c13ddba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:34.973487 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b31e4b4e-4044-4f88-ac68-353c9c13ddba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:34.974443 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b31e4b4e-4044-4f88-ac68-353c9c13ddba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:34.975139 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b31e4b4e-4044-4f88-ac68-353c9c13ddba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:34.975616 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b31e4b4e-4044-4f88-ac68-353c9c13ddba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:34.976050 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b31e4b4e-4044-4f88-ac68-353c9c13ddba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:35.211439 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b31e4b4e-4044-4f88-ac68-353c9c13ddba tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "DELETE /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611/os-volume_attachments/58f6e317-259f-4f57-89c0-7dfa3322648a" status: 202 len: 0 microversion: 2.20 time: 0.248678 Sep 14 01:14:35.212058 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 498/990] 10.222.0.42 () {60 vars in 1457 bytes} [Wed Sep 14 01:14:34 2022] DELETE /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611/os-volume_attachments/58f6e317-259f-4f57-89c0-7dfa3322648a => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 01:14:35.273149 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-bc84fb3e-9ab2-43d0-b9b6-215f9b155ff1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:14:35.273746 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-bc84fb3e-9ab2-43d0-b9b6-215f9b155ff1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:35.280539 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bc84fb3e-9ab2-43d0-b9b6-215f9b155ff1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:35.281034 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bc84fb3e-9ab2-43d0-b9b6-215f9b155ff1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:35.281402 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bc84fb3e-9ab2-43d0-b9b6-215f9b155ff1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:35.282105 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bc84fb3e-9ab2-43d0-b9b6-215f9b155ff1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:35.282563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bc84fb3e-9ab2-43d0-b9b6-215f9b155ff1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:35.282973 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bc84fb3e-9ab2-43d0-b9b6-215f9b155ff1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:35.312654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-bc84fb3e-9ab2-43d0-b9b6-215f9b155ff1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120620) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 01:14:35.376239 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-bc84fb3e-9ab2-43d0-b9b6-215f9b155ff1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "POST /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611/action" status: 202 len: 0 microversion: 2.20 time: 0.107626 Sep 14 01:14:35.376871 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 493/991] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Sep 14 01:14:35 2022] POST /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 01:14:35.385702 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ba53a4fa-7688-4235-a8e1-fdd252a031f2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:35.386310 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ba53a4fa-7688-4235-a8e1-fdd252a031f2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:35.394173 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ba53a4fa-7688-4235-a8e1-fdd252a031f2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:35.394173 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ba53a4fa-7688-4235-a8e1-fdd252a031f2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:35.394381 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ba53a4fa-7688-4235-a8e1-fdd252a031f2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:35.395040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ba53a4fa-7688-4235-a8e1-fdd252a031f2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:35.395488 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ba53a4fa-7688-4235-a8e1-fdd252a031f2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:35.397041 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ba53a4fa-7688-4235-a8e1-fdd252a031f2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:35.564208 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ba53a4fa-7688-4235-a8e1-fdd252a031f2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:35.572569 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ba53a4fa-7688-4235-a8e1-fdd252a031f2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:35.573992 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ba53a4fa-7688-4235-a8e1-fdd252a031f2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:35.575278 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ba53a4fa-7688-4235-a8e1-fdd252a031f2 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1674 microversion: 2.20 time: 0.194033 Sep 14 01:14:35.575986 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 499/992] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:35 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1674 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:14:36.601680 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6b201c05-d825-4887-8614-4baeca998904 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:36.602287 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-6b201c05-d825-4887-8614-4baeca998904 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:36.604143 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:36.610096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6b201c05-d825-4887-8614-4baeca998904 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:36.610587 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6b201c05-d825-4887-8614-4baeca998904 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:36.611021 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6b201c05-d825-4887-8614-4baeca998904 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:36.611751 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6b201c05-d825-4887-8614-4baeca998904 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:36.612214 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6b201c05-d825-4887-8614-4baeca998904 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:36.612633 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6b201c05-d825-4887-8614-4baeca998904 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:36.747788 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6b201c05-d825-4887-8614-4baeca998904 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:36.756862 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6b201c05-d825-4887-8614-4baeca998904 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:36.758322 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6b201c05-d825-4887-8614-4baeca998904 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:36.759610 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-6b201c05-d825-4887-8614-4baeca998904 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.162820 Sep 14 01:14:36.760167 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 494/993] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:36 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:14:37.785377 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b2fa6c44-b732-461a-892d-054a777a111a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:37.787316 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b2fa6c44-b732-461a-892d-054a777a111a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:37.793777 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:37.795496 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b2fa6c44-b732-461a-892d-054a777a111a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:37.796268 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b2fa6c44-b732-461a-892d-054a777a111a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:37.797012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b2fa6c44-b732-461a-892d-054a777a111a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:37.797829 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b2fa6c44-b732-461a-892d-054a777a111a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:37.798506 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b2fa6c44-b732-461a-892d-054a777a111a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:37.799177 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b2fa6c44-b732-461a-892d-054a777a111a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:37.889791 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6474e9fa-ecf2-4fd9-9289-bee25f1ed70f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:37.891431 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-6474e9fa-ecf2-4fd9-9289-bee25f1ed70f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:37.898764 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6474e9fa-ecf2-4fd9-9289-bee25f1ed70f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:37.899245 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6474e9fa-ecf2-4fd9-9289-bee25f1ed70f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:37.899700 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6474e9fa-ecf2-4fd9-9289-bee25f1ed70f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:37.900575 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6474e9fa-ecf2-4fd9-9289-bee25f1ed70f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:37.901029 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6474e9fa-ecf2-4fd9-9289-bee25f1ed70f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:37.901449 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6474e9fa-ecf2-4fd9-9289-bee25f1ed70f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:37.931967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-6474e9fa-ecf2-4fd9-9289-bee25f1ed70f tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/ips" status: 200 len: 145 microversion: 2.1 time: 0.046604 Sep 14 01:14:37.948528 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b2fa6c44-b732-461a-892d-054a777a111a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:37.951920 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 495/994] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Sep 14 01:14:37 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/ips => generated 145 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:14:37.961451 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b2fa6c44-b732-461a-892d-054a777a111a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:37.963378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-b2fa6c44-b732-461a-892d-054a777a111a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:37.965267 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b2fa6c44-b732-461a-892d-054a777a111a tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.183895 Sep 14 01:14:37.965934 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 500/995] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:37 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:38.991568 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-54e90992-bbfd-47c3-879e-0d92b895e700 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:38.992200 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-54e90992-bbfd-47c3-879e-0d92b895e700 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:38.999002 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-54e90992-bbfd-47c3-879e-0d92b895e700 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:38.999490 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-54e90992-bbfd-47c3-879e-0d92b895e700 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:38.999959 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-54e90992-bbfd-47c3-879e-0d92b895e700 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:39.000657 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-54e90992-bbfd-47c3-879e-0d92b895e700 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:39.001113 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-54e90992-bbfd-47c3-879e-0d92b895e700 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:39.001539 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-54e90992-bbfd-47c3-879e-0d92b895e700 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:39.278713 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-54e90992-bbfd-47c3-879e-0d92b895e700 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:39.288518 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-54e90992-bbfd-47c3-879e-0d92b895e700 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:39.289980 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-54e90992-bbfd-47c3-879e-0d92b895e700 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:39.291162 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-54e90992-bbfd-47c3-879e-0d92b895e700 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.303609 Sep 14 01:14:39.309462 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 496/996] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:38 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:39.402433 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b24ed872-fa45-4729-bb96-c043f497026c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29b03440-dce9-4863-80a3-6000f3a57f3f"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:14:39.405419 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b24ed872-fa45-4729-bb96-c043f497026c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:39.412668 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b24ed872-fa45-4729-bb96-c043f497026c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:39.413226 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b24ed872-fa45-4729-bb96-c043f497026c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:39.413667 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b24ed872-fa45-4729-bb96-c043f497026c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:39.414383 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b24ed872-fa45-4729-bb96-c043f497026c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:39.414985 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b24ed872-fa45-4729-bb96-c043f497026c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:39.415493 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b24ed872-fa45-4729-bb96-c043f497026c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:40.317489 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6b0fe794-cee8-4e57-9ee3-6f24844e0c40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:40.318597 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-6b0fe794-cee8-4e57-9ee3-6f24844e0c40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:40.326536 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6b0fe794-cee8-4e57-9ee3-6f24844e0c40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:40.327137 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6b0fe794-cee8-4e57-9ee3-6f24844e0c40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:40.327768 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6b0fe794-cee8-4e57-9ee3-6f24844e0c40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:40.328578 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6b0fe794-cee8-4e57-9ee3-6f24844e0c40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:40.329104 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6b0fe794-cee8-4e57-9ee3-6f24844e0c40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:40.329600 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6b0fe794-cee8-4e57-9ee3-6f24844e0c40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:40.469180 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6b0fe794-cee8-4e57-9ee3-6f24844e0c40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:40.485894 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6b0fe794-cee8-4e57-9ee3-6f24844e0c40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:40.487337 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6b0fe794-cee8-4e57-9ee3-6f24844e0c40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:40.488567 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-6b0fe794-cee8-4e57-9ee3-6f24844e0c40 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.175219 Sep 14 01:14:40.489128 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 497/997] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:40 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:14:41.515010 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-710a65e2-0d1f-4835-963f-4e99256cdb76 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:41.515858 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-710a65e2-0d1f-4835-963f-4e99256cdb76 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:41.522766 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-710a65e2-0d1f-4835-963f-4e99256cdb76 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:41.523264 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-710a65e2-0d1f-4835-963f-4e99256cdb76 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:41.523763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-710a65e2-0d1f-4835-963f-4e99256cdb76 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:41.524470 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-710a65e2-0d1f-4835-963f-4e99256cdb76 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:41.524944 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-710a65e2-0d1f-4835-963f-4e99256cdb76 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:41.525394 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-710a65e2-0d1f-4835-963f-4e99256cdb76 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:41.666294 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-710a65e2-0d1f-4835-963f-4e99256cdb76 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:41.674633 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-710a65e2-0d1f-4835-963f-4e99256cdb76 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:41.676087 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-710a65e2-0d1f-4835-963f-4e99256cdb76 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:41.677553 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-710a65e2-0d1f-4835-963f-4e99256cdb76 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.166233 Sep 14 01:14:41.687589 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 498/998] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:41 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:14:42.702264 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-57f53241-f680-4d16-ad1a-4f06e4a4d4d1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:42.703005 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-57f53241-f680-4d16-ad1a-4f06e4a4d4d1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:42.711095 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-57f53241-f680-4d16-ad1a-4f06e4a4d4d1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:42.711695 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-57f53241-f680-4d16-ad1a-4f06e4a4d4d1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:42.712282 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-57f53241-f680-4d16-ad1a-4f06e4a4d4d1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:42.713058 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-57f53241-f680-4d16-ad1a-4f06e4a4d4d1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:42.713519 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-57f53241-f680-4d16-ad1a-4f06e4a4d4d1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:42.713945 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-57f53241-f680-4d16-ad1a-4f06e4a4d4d1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:42.851276 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-57f53241-f680-4d16-ad1a-4f06e4a4d4d1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:42.859251 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-57f53241-f680-4d16-ad1a-4f06e4a4d4d1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:42.860701 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-57f53241-f680-4d16-ad1a-4f06e4a4d4d1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:42.861842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-57f53241-f680-4d16-ad1a-4f06e4a4d4d1 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.163495 Sep 14 01:14:42.862389 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 499/999] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:42 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:14:43.887454 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e0e4de8b-50d7-4337-adfd-244369e663b6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:43.888212 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-e0e4de8b-50d7-4337-adfd-244369e663b6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:43.894397 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e0e4de8b-50d7-4337-adfd-244369e663b6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:43.894877 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e0e4de8b-50d7-4337-adfd-244369e663b6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:43.895858 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e0e4de8b-50d7-4337-adfd-244369e663b6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:43.896648 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e0e4de8b-50d7-4337-adfd-244369e663b6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:43.897108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e0e4de8b-50d7-4337-adfd-244369e663b6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:43.897533 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-e0e4de8b-50d7-4337-adfd-244369e663b6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:44.038966 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e0e4de8b-50d7-4337-adfd-244369e663b6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:44.048495 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e0e4de8b-50d7-4337-adfd-244369e663b6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:44.049946 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-e0e4de8b-50d7-4337-adfd-244369e663b6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:44.051123 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-e0e4de8b-50d7-4337-adfd-244369e663b6 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.167650 Sep 14 01:14:44.051731 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 500/1000] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:43 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:14:45.077277 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-eaadc164-2bca-49a3-91d1-513b6d010b3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:45.078069 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-eaadc164-2bca-49a3-91d1-513b6d010b3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:45.084532 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eaadc164-2bca-49a3-91d1-513b6d010b3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:45.085016 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eaadc164-2bca-49a3-91d1-513b6d010b3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:45.085455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eaadc164-2bca-49a3-91d1-513b6d010b3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:45.086141 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eaadc164-2bca-49a3-91d1-513b6d010b3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:45.086598 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eaadc164-2bca-49a3-91d1-513b6d010b3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:45.087030 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eaadc164-2bca-49a3-91d1-513b6d010b3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:45.225590 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-eaadc164-2bca-49a3-91d1-513b6d010b3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:45.234920 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-eaadc164-2bca-49a3-91d1-513b6d010b3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:45.236389 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-eaadc164-2bca-49a3-91d1-513b6d010b3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:45.237574 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-eaadc164-2bca-49a3-91d1-513b6d010b3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.164215 Sep 14 01:14:45.238136 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 501/1001] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:45 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:14:46.265633 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-b8da4aa4-d0cd-477c-9fb3-e77e749d6076 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:46.266431 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-b8da4aa4-d0cd-477c-9fb3-e77e749d6076 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:46.274137 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b8da4aa4-d0cd-477c-9fb3-e77e749d6076 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:46.274850 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b8da4aa4-d0cd-477c-9fb3-e77e749d6076 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:46.275304 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b8da4aa4-d0cd-477c-9fb3-e77e749d6076 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:46.276286 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b8da4aa4-d0cd-477c-9fb3-e77e749d6076 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:46.276763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b8da4aa4-d0cd-477c-9fb3-e77e749d6076 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:46.277324 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b8da4aa4-d0cd-477c-9fb3-e77e749d6076 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:46.419170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b8da4aa4-d0cd-477c-9fb3-e77e749d6076 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:46.427315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b8da4aa4-d0cd-477c-9fb3-e77e749d6076 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:46.428801 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b8da4aa4-d0cd-477c-9fb3-e77e749d6076 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:46.429951 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-b8da4aa4-d0cd-477c-9fb3-e77e749d6076 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.168345 Sep 14 01:14:46.430530 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 502/1002] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:46 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:14:47.458159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ed7149d3-92da-4b29-be5f-441df1b97caf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:47.459240 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ed7149d3-92da-4b29-be5f-441df1b97caf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:47.467179 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ed7149d3-92da-4b29-be5f-441df1b97caf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:47.467951 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ed7149d3-92da-4b29-be5f-441df1b97caf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:47.468610 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ed7149d3-92da-4b29-be5f-441df1b97caf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:47.469346 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ed7149d3-92da-4b29-be5f-441df1b97caf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:47.469866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ed7149d3-92da-4b29-be5f-441df1b97caf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:47.470412 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ed7149d3-92da-4b29-be5f-441df1b97caf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:47.613099 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ed7149d3-92da-4b29-be5f-441df1b97caf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:47.621176 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ed7149d3-92da-4b29-be5f-441df1b97caf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:47.622614 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ed7149d3-92da-4b29-be5f-441df1b97caf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:47.623806 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ed7149d3-92da-4b29-be5f-441df1b97caf tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.171351 Sep 14 01:14:47.624364 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 503/1003] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:47 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:14:48.650041 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-326964e1-1930-41bd-a152-58bf597776ca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:48.650758 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-326964e1-1930-41bd-a152-58bf597776ca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:48.657112 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-326964e1-1930-41bd-a152-58bf597776ca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:48.657593 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-326964e1-1930-41bd-a152-58bf597776ca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:48.658027 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-326964e1-1930-41bd-a152-58bf597776ca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:48.658719 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-326964e1-1930-41bd-a152-58bf597776ca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:48.659177 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-326964e1-1930-41bd-a152-58bf597776ca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:48.659660 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-326964e1-1930-41bd-a152-58bf597776ca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:48.789550 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-326964e1-1930-41bd-a152-58bf597776ca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:48.798565 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-326964e1-1930-41bd-a152-58bf597776ca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:48.800152 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-326964e1-1930-41bd-a152-58bf597776ca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:48.802204 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-326964e1-1930-41bd-a152-58bf597776ca tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.156388 Sep 14 01:14:48.803055 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 504/1004] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:48 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:14:49.410148 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=3 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:49.601596 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:49.827287 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a6c53a5f-1c5b-4dc7-b707-edea406b7637 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:49.827851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a6c53a5f-1c5b-4dc7-b707-edea406b7637 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:49.834568 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a6c53a5f-1c5b-4dc7-b707-edea406b7637 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:49.835050 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a6c53a5f-1c5b-4dc7-b707-edea406b7637 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:49.835481 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a6c53a5f-1c5b-4dc7-b707-edea406b7637 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:49.836195 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a6c53a5f-1c5b-4dc7-b707-edea406b7637 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:49.836642 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a6c53a5f-1c5b-4dc7-b707-edea406b7637 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:49.837066 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a6c53a5f-1c5b-4dc7-b707-edea406b7637 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:49.857890 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:14:49.971013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a6c53a5f-1c5b-4dc7-b707-edea406b7637 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:49.979322 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a6c53a5f-1c5b-4dc7-b707-edea406b7637 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:49.980789 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a6c53a5f-1c5b-4dc7-b707-edea406b7637 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:49.981930 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a6c53a5f-1c5b-4dc7-b707-edea406b7637 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.158571 Sep 14 01:14:49.982484 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 505/1005] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:49 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:14:51.008554 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-fa2d89a3-4123-4bf3-b591-295c44bc3d4f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:51.009225 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-fa2d89a3-4123-4bf3-b591-295c44bc3d4f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:51.015695 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa2d89a3-4123-4bf3-b591-295c44bc3d4f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:51.016125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa2d89a3-4123-4bf3-b591-295c44bc3d4f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:51.016565 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa2d89a3-4123-4bf3-b591-295c44bc3d4f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:51.017251 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa2d89a3-4123-4bf3-b591-295c44bc3d4f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:51.017737 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa2d89a3-4123-4bf3-b591-295c44bc3d4f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:51.018161 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa2d89a3-4123-4bf3-b591-295c44bc3d4f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:51.144840 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-fa2d89a3-4123-4bf3-b591-295c44bc3d4f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:51.153618 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-fa2d89a3-4123-4bf3-b591-295c44bc3d4f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:51.155058 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-fa2d89a3-4123-4bf3-b591-295c44bc3d4f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:51.156243 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-fa2d89a3-4123-4bf3-b591-295c44bc3d4f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.152559 Sep 14 01:14:51.156798 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 506/1006] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:51 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:14:52.181811 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-434a1563-52b0-4044-a4f5-c8abf21881f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:52.182497 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-434a1563-52b0-4044-a4f5-c8abf21881f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:52.188877 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-434a1563-52b0-4044-a4f5-c8abf21881f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:52.189362 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-434a1563-52b0-4044-a4f5-c8abf21881f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:52.189802 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-434a1563-52b0-4044-a4f5-c8abf21881f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:52.190495 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-434a1563-52b0-4044-a4f5-c8abf21881f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:52.191213 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-434a1563-52b0-4044-a4f5-c8abf21881f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:52.191671 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-434a1563-52b0-4044-a4f5-c8abf21881f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:52.323212 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-434a1563-52b0-4044-a4f5-c8abf21881f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:52.331334 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-434a1563-52b0-4044-a4f5-c8abf21881f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:52.332854 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-434a1563-52b0-4044-a4f5-c8abf21881f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:52.334006 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-434a1563-52b0-4044-a4f5-c8abf21881f3 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.156178 Sep 14 01:14:52.334562 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 507/1007] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:52 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:14:53.359451 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2b5b9659-72f7-4daf-83f4-a252ac98a2e7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:53.360106 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2b5b9659-72f7-4daf-83f4-a252ac98a2e7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:53.366490 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2b5b9659-72f7-4daf-83f4-a252ac98a2e7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:53.366969 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2b5b9659-72f7-4daf-83f4-a252ac98a2e7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:53.367400 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2b5b9659-72f7-4daf-83f4-a252ac98a2e7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:53.368110 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2b5b9659-72f7-4daf-83f4-a252ac98a2e7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:53.368555 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2b5b9659-72f7-4daf-83f4-a252ac98a2e7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:53.368973 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2b5b9659-72f7-4daf-83f4-a252ac98a2e7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:53.497025 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-2b5b9659-72f7-4daf-83f4-a252ac98a2e7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:53.506061 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-2b5b9659-72f7-4daf-83f4-a252ac98a2e7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:53.507489 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-2b5b9659-72f7-4daf-83f4-a252ac98a2e7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:53.508650 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2b5b9659-72f7-4daf-83f4-a252ac98a2e7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.153132 Sep 14 01:14:53.509200 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 508/1008] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:53 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 01:14:54.434540 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b24ed872-fa45-4729-bb96-c043f497026c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "POST /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 15.035787 Sep 14 01:14:54.435099 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 501/1009] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 01:14:39 2022] POST /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments => generated 194 bytes in 15037 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:14:54.534558 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-fec467cd-98ed-44a7-8856-4ed08585e83c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:54.535967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-fec467cd-98ed-44a7-8856-4ed08585e83c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:54.542827 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fec467cd-98ed-44a7-8856-4ed08585e83c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:54.543375 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fec467cd-98ed-44a7-8856-4ed08585e83c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:54.543794 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fec467cd-98ed-44a7-8856-4ed08585e83c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:54.544490 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fec467cd-98ed-44a7-8856-4ed08585e83c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:54.544950 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fec467cd-98ed-44a7-8856-4ed08585e83c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:54.545375 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fec467cd-98ed-44a7-8856-4ed08585e83c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:54.686906 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-fec467cd-98ed-44a7-8856-4ed08585e83c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:54.695906 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-fec467cd-98ed-44a7-8856-4ed08585e83c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:54.697620 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-fec467cd-98ed-44a7-8856-4ed08585e83c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:54.698788 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-fec467cd-98ed-44a7-8856-4ed08585e83c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.168462 Sep 14 01:14:54.699354 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 509/1010] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:54 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:55.726704 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-479fe2cc-6c35-4bc3-bd87-ef8756721f84 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:55.727397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-479fe2cc-6c35-4bc3-bd87-ef8756721f84 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:55.733465 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-479fe2cc-6c35-4bc3-bd87-ef8756721f84 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:55.733946 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-479fe2cc-6c35-4bc3-bd87-ef8756721f84 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:55.734376 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-479fe2cc-6c35-4bc3-bd87-ef8756721f84 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:55.735061 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-479fe2cc-6c35-4bc3-bd87-ef8756721f84 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:55.735514 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-479fe2cc-6c35-4bc3-bd87-ef8756721f84 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:55.735962 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-479fe2cc-6c35-4bc3-bd87-ef8756721f84 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:55.871894 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-479fe2cc-6c35-4bc3-bd87-ef8756721f84 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:55.879941 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-479fe2cc-6c35-4bc3-bd87-ef8756721f84 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:55.881654 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-479fe2cc-6c35-4bc3-bd87-ef8756721f84 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:55.882806 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-479fe2cc-6c35-4bc3-bd87-ef8756721f84 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.161429 Sep 14 01:14:55.883366 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 502/1011] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:55 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:56.909033 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-91c4fcf4-1a9d-4ac0-8b78-2e9505c20792 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:56.909560 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-91c4fcf4-1a9d-4ac0-8b78-2e9505c20792 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:56.916126 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-91c4fcf4-1a9d-4ac0-8b78-2e9505c20792 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:56.916611 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-91c4fcf4-1a9d-4ac0-8b78-2e9505c20792 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:56.917053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-91c4fcf4-1a9d-4ac0-8b78-2e9505c20792 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:56.917746 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-91c4fcf4-1a9d-4ac0-8b78-2e9505c20792 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:56.918209 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-91c4fcf4-1a9d-4ac0-8b78-2e9505c20792 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:56.919034 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-91c4fcf4-1a9d-4ac0-8b78-2e9505c20792 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:57.045566 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-91c4fcf4-1a9d-4ac0-8b78-2e9505c20792 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:57.053546 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-91c4fcf4-1a9d-4ac0-8b78-2e9505c20792 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:57.054967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-91c4fcf4-1a9d-4ac0-8b78-2e9505c20792 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:57.056144 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-91c4fcf4-1a9d-4ac0-8b78-2e9505c20792 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.151444 Sep 14 01:14:57.056700 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 510/1012] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:56 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:57.534323 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-696f56cf-5cf3-4cb9-bea4-f125ef4799f1 req-ec3d8317-fea2-4a2c-92fd-80f94636edab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291f27aa-9e42-4937-be7d-5e849d90e611", "name": "network-vif-plugged", "status": "completed", "tag": "5a0c8ef2-8392-47a2-bf1c-1530912083d1"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:14:57.545406 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-696f56cf-5cf3-4cb9-bea4-f125ef4799f1 req-ec3d8317-fea2-4a2c-92fd-80f94636edab service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:57.545892 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-696f56cf-5cf3-4cb9-bea4-f125ef4799f1 req-ec3d8317-fea2-4a2c-92fd-80f94636edab service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:57.546331 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-696f56cf-5cf3-4cb9-bea4-f125ef4799f1 req-ec3d8317-fea2-4a2c-92fd-80f94636edab service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:57.557531 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-696f56cf-5cf3-4cb9-bea4-f125ef4799f1 req-ec3d8317-fea2-4a2c-92fd-80f94636edab service nova] Creating event network-vif-plugged:5a0c8ef2-8392-47a2-bf1c-1530912083d1 for instance 291f27aa-9e42-4937-be7d-5e849d90e611 on hv-cinder-85752 Sep 14 01:14:57.562539 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-696f56cf-5cf3-4cb9-bea4-f125ef4799f1 req-ec3d8317-fea2-4a2c-92fd-80f94636edab service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032184 Sep 14 01:14:57.563131 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 503/1013] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:14:58.085655 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9d05b1c3-a9d9-49c8-9183-6b956998ed47 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:58.086215 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9d05b1c3-a9d9-49c8-9183-6b956998ed47 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:58.092587 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9d05b1c3-a9d9-49c8-9183-6b956998ed47 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:58.093090 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9d05b1c3-a9d9-49c8-9183-6b956998ed47 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:58.093512 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9d05b1c3-a9d9-49c8-9183-6b956998ed47 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:58.094208 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9d05b1c3-a9d9-49c8-9183-6b956998ed47 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:58.094666 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9d05b1c3-a9d9-49c8-9183-6b956998ed47 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:58.095097 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9d05b1c3-a9d9-49c8-9183-6b956998ed47 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:58.227673 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9d05b1c3-a9d9-49c8-9183-6b956998ed47 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:58.236560 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9d05b1c3-a9d9-49c8-9183-6b956998ed47 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:58.238156 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9d05b1c3-a9d9-49c8-9183-6b956998ed47 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:58.239383 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9d05b1c3-a9d9-49c8-9183-6b956998ed47 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.158192 Sep 14 01:14:58.240030 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 511/1014] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:58 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:14:59.264973 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-01ac49fb-aeff-40d5-8b81-677cbd72687c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:14:59.265670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-01ac49fb-aeff-40d5-8b81-677cbd72687c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:14:59.271924 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-01ac49fb-aeff-40d5-8b81-677cbd72687c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:59.272407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-01ac49fb-aeff-40d5-8b81-677cbd72687c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:59.272846 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-01ac49fb-aeff-40d5-8b81-677cbd72687c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:59.273534 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-01ac49fb-aeff-40d5-8b81-677cbd72687c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:14:59.273992 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-01ac49fb-aeff-40d5-8b81-677cbd72687c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:14:59.274415 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-01ac49fb-aeff-40d5-8b81-677cbd72687c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:14:59.406957 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-01ac49fb-aeff-40d5-8b81-677cbd72687c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:59.416140 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-01ac49fb-aeff-40d5-8b81-677cbd72687c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:59.417577 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-01ac49fb-aeff-40d5-8b81-677cbd72687c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:14:59.418729 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-01ac49fb-aeff-40d5-8b81-677cbd72687c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.158546 Sep 14 01:14:59.419292 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 504/1015] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:14:59 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:15:00.444459 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-26cb6116-29bf-4ea6-a9ba-76f100c20fed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:00.445146 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-26cb6116-29bf-4ea6-a9ba-76f100c20fed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:00.451699 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-26cb6116-29bf-4ea6-a9ba-76f100c20fed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:00.452178 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-26cb6116-29bf-4ea6-a9ba-76f100c20fed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:00.452614 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-26cb6116-29bf-4ea6-a9ba-76f100c20fed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:00.453302 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-26cb6116-29bf-4ea6-a9ba-76f100c20fed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:00.453750 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-26cb6116-29bf-4ea6-a9ba-76f100c20fed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:00.454183 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-26cb6116-29bf-4ea6-a9ba-76f100c20fed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:00.589151 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-26cb6116-29bf-4ea6-a9ba-76f100c20fed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:00.597315 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-26cb6116-29bf-4ea6-a9ba-76f100c20fed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:00.598751 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-26cb6116-29bf-4ea6-a9ba-76f100c20fed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:00.600453 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-26cb6116-29bf-4ea6-a9ba-76f100c20fed tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1732 microversion: 2.20 time: 0.160226 Sep 14 01:15:00.601014 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 512/1016] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:15:00 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:15:01.626497 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2f76169a-035f-46a7-a453-d0f0f9e4a03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:01.627115 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2f76169a-035f-46a7-a453-d0f0f9e4a03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:01.636173 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f76169a-035f-46a7-a453-d0f0f9e4a03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:01.636666 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f76169a-035f-46a7-a453-d0f0f9e4a03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:01.637103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f76169a-035f-46a7-a453-d0f0f9e4a03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:01.637801 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f76169a-035f-46a7-a453-d0f0f9e4a03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:01.638257 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f76169a-035f-46a7-a453-d0f0f9e4a03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:01.638688 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f76169a-035f-46a7-a453-d0f0f9e4a03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:01.770175 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2f76169a-035f-46a7-a453-d0f0f9e4a03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:01.778601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2f76169a-035f-46a7-a453-d0f0f9e4a03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:01.780078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2f76169a-035f-46a7-a453-d0f0f9e4a03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:01.781236 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2f76169a-035f-46a7-a453-d0f0f9e4a03c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1719 microversion: 2.20 time: 0.158783 Sep 14 01:15:01.781793 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 505/1017] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:15:01 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:15:01.986170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-cb89d54c-8441-40ef-b5d4-f236f67f59fb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:01.988757 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-cb89d54c-8441-40ef-b5d4-f236f67f59fb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:01.995201 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cb89d54c-8441-40ef-b5d4-f236f67f59fb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:01.995722 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cb89d54c-8441-40ef-b5d4-f236f67f59fb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:01.996158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cb89d54c-8441-40ef-b5d4-f236f67f59fb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:01.996848 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cb89d54c-8441-40ef-b5d4-f236f67f59fb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:01.997311 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cb89d54c-8441-40ef-b5d4-f236f67f59fb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:01.997741 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cb89d54c-8441-40ef-b5d4-f236f67f59fb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:02.027802 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-cb89d54c-8441-40ef-b5d4-f236f67f59fb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045433 Sep 14 01:15:02.028306 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 513/1018] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 01:15:01 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:15:02.039719 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e7b8d845-3c48-480c-b526-3f28d805f8af tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:02.040219 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e7b8d845-3c48-480c-b526-3f28d805f8af tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:02.046060 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7b8d845-3c48-480c-b526-3f28d805f8af tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:02.046578 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7b8d845-3c48-480c-b526-3f28d805f8af tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:02.047020 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7b8d845-3c48-480c-b526-3f28d805f8af tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:02.047751 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7b8d845-3c48-480c-b526-3f28d805f8af tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:02.048213 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7b8d845-3c48-480c-b526-3f28d805f8af tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:02.048643 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7b8d845-3c48-480c-b526-3f28d805f8af tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:02.077085 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e7b8d845-3c48-480c-b526-3f28d805f8af tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments/29b03440-dce9-4863-80a3-6000f3a57f3f" status: 200 len: 194 microversion: 2.1 time: 0.041864 Sep 14 01:15:02.077648 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 506/1019] 10.222.0.42 () {58 vars in 1413 bytes} [Wed Sep 14 01:15:02 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments/29b03440-dce9-4863-80a3-6000f3a57f3f => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:15:03.410743 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0666400a-99f7-4f54-a657-9bbe75dfd1d0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0110d579-0790-413b-87d0-727e64cd7ce1"}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:15:03.413690 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0666400a-99f7-4f54-a657-9bbe75dfd1d0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:03.420029 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0666400a-99f7-4f54-a657-9bbe75dfd1d0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:03.420526 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0666400a-99f7-4f54-a657-9bbe75dfd1d0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:03.420952 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0666400a-99f7-4f54-a657-9bbe75dfd1d0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:03.421641 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0666400a-99f7-4f54-a657-9bbe75dfd1d0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:03.422098 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0666400a-99f7-4f54-a657-9bbe75dfd1d0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:03.422524 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0666400a-99f7-4f54-a657-9bbe75dfd1d0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:03.691071 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0666400a-99f7-4f54-a657-9bbe75dfd1d0 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "POST /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283992 Sep 14 01:15:03.691692 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 514/1020] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 01:15:03 2022] POST /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:15:11.227261 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0894d7bd-1b2f-4812-987f-4a20392a9bfb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:11.229501 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0894d7bd-1b2f-4812-987f-4a20392a9bfb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:11.236394 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0894d7bd-1b2f-4812-987f-4a20392a9bfb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:11.236878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0894d7bd-1b2f-4812-987f-4a20392a9bfb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:11.237316 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0894d7bd-1b2f-4812-987f-4a20392a9bfb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:11.238005 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0894d7bd-1b2f-4812-987f-4a20392a9bfb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:11.238464 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0894d7bd-1b2f-4812-987f-4a20392a9bfb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:11.238890 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0894d7bd-1b2f-4812-987f-4a20392a9bfb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:11.270608 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0894d7bd-1b2f-4812-987f-4a20392a9bfb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047749 Sep 14 01:15:11.271160 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 507/1021] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 01:15:11 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:15:11.412777 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-fd76c5f3-0573-4719-96bc-6d94aa847e90 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:11.413357 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-fd76c5f3-0573-4719-96bc-6d94aa847e90 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:11.416054 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=42 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:15:11.421417 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fd76c5f3-0573-4719-96bc-6d94aa847e90 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:11.421905 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fd76c5f3-0573-4719-96bc-6d94aa847e90 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:11.422340 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fd76c5f3-0573-4719-96bc-6d94aa847e90 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:11.423035 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fd76c5f3-0573-4719-96bc-6d94aa847e90 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:11.423493 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fd76c5f3-0573-4719-96bc-6d94aa847e90 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:11.424012 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fd76c5f3-0573-4719-96bc-6d94aa847e90 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:11.452110 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-fd76c5f3-0573-4719-96bc-6d94aa847e90 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments/29b03440-dce9-4863-80a3-6000f3a57f3f" status: 200 len: 194 microversion: 2.1 time: 0.044297 Sep 14 01:15:11.452693 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 515/1022] 10.222.0.42 () {58 vars in 1413 bytes} [Wed Sep 14 01:15:11 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments/29b03440-dce9-4863-80a3-6000f3a57f3f => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:15:11.463772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-728020b4-e3f1-4bec-a39e-89e484679e6a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:11.464266 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-728020b4-e3f1-4bec-a39e-89e484679e6a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:11.470130 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-728020b4-e3f1-4bec-a39e-89e484679e6a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:11.470631 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-728020b4-e3f1-4bec-a39e-89e484679e6a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:11.471222 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-728020b4-e3f1-4bec-a39e-89e484679e6a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:11.471946 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-728020b4-e3f1-4bec-a39e-89e484679e6a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:11.472401 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-728020b4-e3f1-4bec-a39e-89e484679e6a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:11.472936 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-728020b4-e3f1-4bec-a39e-89e484679e6a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:11.558639 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-728020b4-e3f1-4bec-a39e-89e484679e6a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lazy-loading 'services' on Instance uuid 0febaeca-9ac9-4094-b48f-06bca1b3903d {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:15:11.631659 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-728020b4-e3f1-4bec-a39e-89e484679e6a tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments/29b03440-dce9-4863-80a3-6000f3a57f3f" status: 202 len: 0 microversion: 2.1 time: 0.172336 Sep 14 01:15:11.632230 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 508/1023] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 01:15:11 2022] DELETE /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments/29b03440-dce9-4863-80a3-6000f3a57f3f => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 01:15:13.809966 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-eeec8f69-6e6a-4ec2-bb74-bdb24cc4f139 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:13.810447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-eeec8f69-6e6a-4ec2-bb74-bdb24cc4f139 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:13.816867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eeec8f69-6e6a-4ec2-bb74-bdb24cc4f139 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:13.817354 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eeec8f69-6e6a-4ec2-bb74-bdb24cc4f139 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:13.817790 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eeec8f69-6e6a-4ec2-bb74-bdb24cc4f139 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:13.818487 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eeec8f69-6e6a-4ec2-bb74-bdb24cc4f139 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:13.818945 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eeec8f69-6e6a-4ec2-bb74-bdb24cc4f139 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:13.819369 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-eeec8f69-6e6a-4ec2-bb74-bdb24cc4f139 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:13.852393 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-eeec8f69-6e6a-4ec2-bb74-bdb24cc4f139 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments/0110d579-0790-413b-87d0-727e64cd7ce1" status: 200 len: 194 microversion: 2.1 time: 0.046325 Sep 14 01:15:13.852956 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 516/1024] 10.222.0.42 () {58 vars in 1413 bytes} [Wed Sep 14 01:15:13 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments/0110d579-0790-413b-87d0-727e64cd7ce1 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:15:13.869106 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-52922253-13b2-433e-8c13-6bdaebfc59f7 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:13.869682 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-52922253-13b2-433e-8c13-6bdaebfc59f7 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:13.875890 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52922253-13b2-433e-8c13-6bdaebfc59f7 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:13.876366 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52922253-13b2-433e-8c13-6bdaebfc59f7 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:13.876796 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52922253-13b2-433e-8c13-6bdaebfc59f7 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:13.877580 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52922253-13b2-433e-8c13-6bdaebfc59f7 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:13.877964 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52922253-13b2-433e-8c13-6bdaebfc59f7 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:13.878384 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52922253-13b2-433e-8c13-6bdaebfc59f7 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:13.957825 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-52922253-13b2-433e-8c13-6bdaebfc59f7 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lazy-loading 'services' on Instance uuid 0febaeca-9ac9-4094-b48f-06bca1b3903d {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:15:14.028355 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-52922253-13b2-433e-8c13-6bdaebfc59f7 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments/0110d579-0790-413b-87d0-727e64cd7ce1" status: 202 len: 0 microversion: 2.1 time: 0.164607 Sep 14 01:15:14.028932 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 509/1025] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 01:15:13 2022] DELETE /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments/0110d579-0790-413b-87d0-727e64cd7ce1 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:15:15.202213 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-f46b4126-3ddb-40ae-9407-d523c0edc6bc tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:15.204399 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-f46b4126-3ddb-40ae-9407-d523c0edc6bc tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:15.210903 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f46b4126-3ddb-40ae-9407-d523c0edc6bc tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:15.211489 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f46b4126-3ddb-40ae-9407-d523c0edc6bc tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:15.211957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f46b4126-3ddb-40ae-9407-d523c0edc6bc tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:15.212646 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f46b4126-3ddb-40ae-9407-d523c0edc6bc tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:15.213103 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f46b4126-3ddb-40ae-9407-d523c0edc6bc tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:15.213528 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f46b4126-3ddb-40ae-9407-d523c0edc6bc tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:15.255192 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-f46b4126-3ddb-40ae-9407-d523c0edc6bc tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056828 Sep 14 01:15:15.256057 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 517/1026] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 01:15:15 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 01:15:15.375193 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-dcc753c6-a868-4a4b-a825-145ac7f1abc9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:15.377609 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-dcc753c6-a868-4a4b-a825-145ac7f1abc9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:15.384921 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dcc753c6-a868-4a4b-a825-145ac7f1abc9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:15.385402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dcc753c6-a868-4a4b-a825-145ac7f1abc9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:15.385840 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dcc753c6-a868-4a4b-a825-145ac7f1abc9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:15.386528 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dcc753c6-a868-4a4b-a825-145ac7f1abc9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:15.386983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dcc753c6-a868-4a4b-a825-145ac7f1abc9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:15.387406 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dcc753c6-a868-4a4b-a825-145ac7f1abc9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:15.415415 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-dcc753c6-a868-4a4b-a825-145ac7f1abc9 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045191 Sep 14 01:15:15.415988 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 510/1027] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 01:15:15 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 01:15:15.480687 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-dad8d0ed-0630-4483-ba70-43a5ca981f5c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:15.481187 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-dad8d0ed-0630-4483-ba70-43a5ca981f5c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:15.487580 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-dad8d0ed-0630-4483-ba70-43a5ca981f5c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:15.488067 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-dad8d0ed-0630-4483-ba70-43a5ca981f5c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:15.488505 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-dad8d0ed-0630-4483-ba70-43a5ca981f5c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:15.489194 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-dad8d0ed-0630-4483-ba70-43a5ca981f5c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:15.489650 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-dad8d0ed-0630-4483-ba70-43a5ca981f5c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:15.490072 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-dad8d0ed-0630-4483-ba70-43a5ca981f5c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:15.518234 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-dad8d0ed-0630-4483-ba70-43a5ca981f5c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Going to try to terminate instance {{(pid=120620) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:15:15.592099 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-dad8d0ed-0630-4483-ba70-43a5ca981f5c tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d" status: 204 len: 0 microversion: 2.1 time: 0.115527 Sep 14 01:15:15.592913 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 518/1028] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:15:15 2022] DELETE /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 01:15:15.600961 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2c5d0b8d-e771-40ca-bfb0-1cb5daeae4bb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:15.602205 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2c5d0b8d-e771-40ca-bfb0-1cb5daeae4bb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:15.608184 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2c5d0b8d-e771-40ca-bfb0-1cb5daeae4bb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:15.608668 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2c5d0b8d-e771-40ca-bfb0-1cb5daeae4bb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:15.609112 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2c5d0b8d-e771-40ca-bfb0-1cb5daeae4bb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:15.609809 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2c5d0b8d-e771-40ca-bfb0-1cb5daeae4bb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:15.610270 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2c5d0b8d-e771-40ca-bfb0-1cb5daeae4bb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:15.610696 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2c5d0b8d-e771-40ca-bfb0-1cb5daeae4bb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:15.739177 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2c5d0b8d-e771-40ca-bfb0-1cb5daeae4bb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:15.747743 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2c5d0b8d-e771-40ca-bfb0-1cb5daeae4bb tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d" status: 200 len: 1672 microversion: 2.1 time: 0.150613 Sep 14 01:15:15.748304 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 511/1029] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:15 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:15:16.771652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6653f5fc-6b51-4eac-9eff-5514a3a42277 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:16.772293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-6653f5fc-6b51-4eac-9eff-5514a3a42277 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:16.778605 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6653f5fc-6b51-4eac-9eff-5514a3a42277 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:16.779090 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6653f5fc-6b51-4eac-9eff-5514a3a42277 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:16.779532 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6653f5fc-6b51-4eac-9eff-5514a3a42277 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:16.780236 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6653f5fc-6b51-4eac-9eff-5514a3a42277 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:16.780694 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6653f5fc-6b51-4eac-9eff-5514a3a42277 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:16.781117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6653f5fc-6b51-4eac-9eff-5514a3a42277 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:16.785070 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:15:16.910775 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6653f5fc-6b51-4eac-9eff-5514a3a42277 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:16.918435 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-6653f5fc-6b51-4eac-9eff-5514a3a42277 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d" status: 200 len: 1672 microversion: 2.1 time: 0.151153 Sep 14 01:15:16.918993 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 519/1030] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:16 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:15:17.942178 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-34da5edb-3d44-40f3-af58-5424859c1c4b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:17.942790 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-34da5edb-3d44-40f3-af58-5424859c1c4b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:17.950068 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-34da5edb-3d44-40f3-af58-5424859c1c4b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:17.950556 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-34da5edb-3d44-40f3-af58-5424859c1c4b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:17.950987 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-34da5edb-3d44-40f3-af58-5424859c1c4b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:17.951783 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-34da5edb-3d44-40f3-af58-5424859c1c4b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:17.952240 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-34da5edb-3d44-40f3-af58-5424859c1c4b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:17.952662 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-34da5edb-3d44-40f3-af58-5424859c1c4b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:18.178335 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-34da5edb-3d44-40f3-af58-5424859c1c4b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:18.187517 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-34da5edb-3d44-40f3-af58-5424859c1c4b tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d" status: 200 len: 1672 microversion: 2.1 time: 0.249185 Sep 14 01:15:18.188041 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 512/1031] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:17 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d => generated 1672 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:15:19.058517 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-3d4c8c47-3458-4540-b40d-a24d3bb29de1 req-b387973e-a7ff-4e30-8daf-4001a8426723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0febaeca-9ac9-4094-b48f-06bca1b3903d", "name": "network-vif-deleted", "tag": "b7686f66-d521-48db-85c3-432d09864c2f"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:15:19.068797 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-3d4c8c47-3458-4540-b40d-a24d3bb29de1 req-b387973e-a7ff-4e30-8daf-4001a8426723 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:19.069552 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-3d4c8c47-3458-4540-b40d-a24d3bb29de1 req-b387973e-a7ff-4e30-8daf-4001a8426723 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:19.070195 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-3d4c8c47-3458-4540-b40d-a24d3bb29de1 req-b387973e-a7ff-4e30-8daf-4001a8426723 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:19.083427 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-3d4c8c47-3458-4540-b40d-a24d3bb29de1 req-b387973e-a7ff-4e30-8daf-4001a8426723 service nova] Creating event network-vif-deleted:b7686f66-d521-48db-85c3-432d09864c2f for instance 0febaeca-9ac9-4094-b48f-06bca1b3903d on hv-cinder-85752 Sep 14 01:15:19.089853 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-3d4c8c47-3458-4540-b40d-a24d3bb29de1 req-b387973e-a7ff-4e30-8daf-4001a8426723 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036013 Sep 14 01:15:19.091164 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 520/1032] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:15:19.212195 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-867dd3a5-8173-4ba6-aadd-8b9411becf04 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:19.214199 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-867dd3a5-8173-4ba6-aadd-8b9411becf04 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:19.221381 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-867dd3a5-8173-4ba6-aadd-8b9411becf04 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:19.222784 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-867dd3a5-8173-4ba6-aadd-8b9411becf04 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:19.223454 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-867dd3a5-8173-4ba6-aadd-8b9411becf04 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:19.224536 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-867dd3a5-8173-4ba6-aadd-8b9411becf04 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:19.225075 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-867dd3a5-8173-4ba6-aadd-8b9411becf04 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:19.225561 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-867dd3a5-8173-4ba6-aadd-8b9411becf04 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:19.267113 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-867dd3a5-8173-4ba6-aadd-8b9411becf04 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:19.267617 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-867dd3a5-8173-4ba6-aadd-8b9411becf04 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:19.268218 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-867dd3a5-8173-4ba6-aadd-8b9411becf04 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:19.268671 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-867dd3a5-8173-4ba6-aadd-8b9411becf04 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lazy-loading 'fault' on Instance uuid 0febaeca-9ac9-4094-b48f-06bca1b3903d {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:15:19.314070 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-867dd3a5-8173-4ba6-aadd-8b9411becf04 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eca12e1e0a64eeeb183a328f338f54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c229f6a4574619a73b2780d2a6528b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:19.324068 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-867dd3a5-8173-4ba6-aadd-8b9411becf04 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d" status: 200 len: 1326 microversion: 2.1 time: 0.116328 Sep 14 01:15:19.327715 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 513/1033] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:19 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d => generated 1326 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:15:20.349062 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-507d15ce-e34d-4bac-9aad-73f27f2b7553 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:20.349785 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-507d15ce-e34d-4bac-9aad-73f27f2b7553 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:20.357356 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-507d15ce-e34d-4bac-9aad-73f27f2b7553 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:20.357838 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-507d15ce-e34d-4bac-9aad-73f27f2b7553 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:20.358276 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-507d15ce-e34d-4bac-9aad-73f27f2b7553 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:20.358965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-507d15ce-e34d-4bac-9aad-73f27f2b7553 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:20.359421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-507d15ce-e34d-4bac-9aad-73f27f2b7553 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:20.359870 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-507d15ce-e34d-4bac-9aad-73f27f2b7553 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:20.373902 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-507d15ce-e34d-4bac-9aad-73f27f2b7553 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] HTTP exception thrown: Instance 0febaeca-9ac9-4094-b48f-06bca1b3903d could not be found. Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-507d15ce-e34d-4bac-9aad-73f27f2b7553 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Request method failure captured: Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d HTTP/1.1 Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISi0xwKkVlqJjAxVxF7ZmdIDRsYSBScRRHN0QLfKSrZcd-i94MQR-bczycroD2TwO7aShD29dyw1atijMWxpkGQvLL205B8oNgcqcmvzSuVNKxb-hZ9GSKA3m2qhBfRG33LfCPhhGK-iTW71D6_0-F7OQ9w7kEOTi31PdC3XgaqhlqE Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 25c229f6a4574619a73b2780d2a6528b Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-AttachVolumeTestJSON-1929180449 Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:15:20.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:15:20.377214 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:15:20.377214 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-AttachVolumeTestJSON-1929180449 Sep 14 01:15:20.377214 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 25c229f6a4574619a73b2780d2a6528b Sep 14 01:15:20.377214 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1929180449 Sep 14 01:15:20.377214 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-AttachVolumeTestJSON-1929180449-project Sep 14 01:15:20.377214 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:15:20.377214 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:15:20.377214 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: 2eca12e1e0a64eeeb183a328f338f54d Sep 14 01:15:20.377214 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-AttachVolumeTestJSON-1929180449-project Sep 14 01:15:20.377214 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:15:20.377214 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance 0febaeca-9ac9-4094-b48f-06bca1b3903d could not be found. Sep 14 01:15:20.377214 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': '0febaeca-9ac9-4094-b48f-06bca1b3903d'} Sep 14 01:15:20.378190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:15:20.378190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:20.378190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:15:20.378190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:15:20.378190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:15:20.378190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:15:20.378190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:15:20.378190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:15:20.378190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:15:20.378190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:15:20.378190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0febaeca-9ac9-4094-b48f-06bca1b3903d could not be found. Sep 14 01:15:20.378190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:20.378190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:20.378190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:20.378190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:20.378190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:20.378190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:20.378190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:15:20.378190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:15:20.378190 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:15:20.379883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:15:20.379883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:15:20.379883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:15:20.379883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:15:20.379883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:15:20.379883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:15:20.379883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:15:20.379883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0febaeca-9ac9-4094-b48f-06bca1b3903d could not be found. Sep 14 01:15:20.379883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:20.379883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:20.379883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:20.379883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:20.379883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:20.379883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:20.379883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:15:20.379883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:15:20.379883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0febaeca-9ac9-4094-b48f-06bca1b3903d could not be found. Sep 14 01:15:20.379883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:20.381713 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-507d15ce-e34d-4bac-9aad-73f27f2b7553 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Returning 404 to user: Instance 0febaeca-9ac9-4094-b48f-06bca1b3903d could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:15:20.381713 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-507d15ce-e34d-4bac-9aad-73f27f2b7553 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d" status: 404 len: 111 microversion: 2.1 time: 0.032613 Sep 14 01:15:20.381713 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 521/1034] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:20 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:15:20.386897 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7b5036fa-bbdf-4181-b898-e4148ef33542 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '.version_select at 0x7f5043e20670>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:20.393910 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=27 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:15:20.406412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7b5036fa-bbdf-4181-b898-e4148ef33542 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-796132565" status: 202 len: 0 microversion: 2.1 time: 0.023247 Sep 14 01:15:20.406910 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 514/1035] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Sep 14 01:15:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-796132565 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:15:23.293117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-60d02811-78fd-46db-aae0-bf3b0304dedf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:23.293619 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-60d02811-78fd-46db-aae0-bf3b0304dedf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:23.300080 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-60d02811-78fd-46db-aae0-bf3b0304dedf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:23.300563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-60d02811-78fd-46db-aae0-bf3b0304dedf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:23.301001 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-60d02811-78fd-46db-aae0-bf3b0304dedf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:23.301692 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-60d02811-78fd-46db-aae0-bf3b0304dedf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:23.302157 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-60d02811-78fd-46db-aae0-bf3b0304dedf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:23.302578 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-60d02811-78fd-46db-aae0-bf3b0304dedf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:23.316236 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-60d02811-78fd-46db-aae0-bf3b0304dedf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] HTTP exception thrown: Instance 0febaeca-9ac9-4094-b48f-06bca1b3903d could not be found. Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-60d02811-78fd-46db-aae0-bf3b0304dedf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Request method failure captured: Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: DELETE /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d HTTP/1.1 Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISi0xwKkVlqJjAxVxF7ZmdIDRsYSBScRRHN0QLfKSrZcd-i94MQR-bczycroD2TwO7aShD29dyw1atijMWxpkGQvLL205B8oNgcqcmvzSuVNKxb-hZ9GSKA3m2qhBfRG33LfCPhhGK-iTW71D6_0-F7OQ9w7kEOTi31PdC3XgaqhlqE Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 25c229f6a4574619a73b2780d2a6528b Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-AttachVolumeTestJSON-1929180449 Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:15:23.317753 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:15:23.319339 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:15:23.319339 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-AttachVolumeTestJSON-1929180449 Sep 14 01:15:23.319339 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 25c229f6a4574619a73b2780d2a6528b Sep 14 01:15:23.319339 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1929180449 Sep 14 01:15:23.319339 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-AttachVolumeTestJSON-1929180449-project Sep 14 01:15:23.319339 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:15:23.319339 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:15:23.319339 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: 2eca12e1e0a64eeeb183a328f338f54d Sep 14 01:15:23.319339 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-AttachVolumeTestJSON-1929180449-project Sep 14 01:15:23.319339 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:15:23.319339 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance 0febaeca-9ac9-4094-b48f-06bca1b3903d could not be found. Sep 14 01:15:23.319339 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': '0febaeca-9ac9-4094-b48f-06bca1b3903d'} Sep 14 01:15:23.320455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:15:23.320455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:23.320455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:15:23.320455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:15:23.320455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:15:23.320455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:15:23.320455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:15:23.320455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:15:23.320455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:15:23.320455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:15:23.320455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0febaeca-9ac9-4094-b48f-06bca1b3903d could not be found. Sep 14 01:15:23.320455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:23.320455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:23.320455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:23.320455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:23.320455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:23.320455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:23.320455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:15:23.320455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:15:23.320455 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:15:23.322165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:15:23.322165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 01:15:23.322165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 01:15:23.322165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 01:15:23.322165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 01:15:23.322165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:15:23.322165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:15:23.322165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:15:23.322165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:15:23.322165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0febaeca-9ac9-4094-b48f-06bca1b3903d could not be found. Sep 14 01:15:23.322165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:23.322165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:23.322165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:23.322165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:23.322165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:23.322165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:23.322165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:15:23.322165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:15:23.322165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0febaeca-9ac9-4094-b48f-06bca1b3903d could not be found. Sep 14 01:15:23.322165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:23.324234 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-60d02811-78fd-46db-aae0-bf3b0304dedf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Returning 404 to user: Instance 0febaeca-9ac9-4094-b48f-06bca1b3903d could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:15:23.324234 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-60d02811-78fd-46db-aae0-bf3b0304dedf tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d" status: 404 len: 111 microversion: 2.1 time: 0.030552 Sep 14 01:15:23.324234 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 522/1036] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:15:23 2022] DELETE /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:15:23.330231 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fe94756e-f93d-4266-b5d0-9b094e945354 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:23.330844 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fe94756e-f93d-4266-b5d0-9b094e945354 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 0febaeca-9ac9-4094-b48f-06bca1b3903d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:23.338004 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fe94756e-f93d-4266-b5d0-9b094e945354 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:23.338492 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fe94756e-f93d-4266-b5d0-9b094e945354 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:23.338932 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fe94756e-f93d-4266-b5d0-9b094e945354 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:23.339657 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fe94756e-f93d-4266-b5d0-9b094e945354 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:23.340120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fe94756e-f93d-4266-b5d0-9b094e945354 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:23.340549 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fe94756e-f93d-4266-b5d0-9b094e945354 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:23.344516 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:15:23.356231 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-fe94756e-f93d-4266-b5d0-9b094e945354 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] HTTP exception thrown: Instance 0febaeca-9ac9-4094-b48f-06bca1b3903d could not be found. Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fe94756e-f93d-4266-b5d0-9b094e945354 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Request method failure captured: Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d HTTP/1.1 Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISi0xwKkVlqJjAxVxF7ZmdIDRsYSBScRRHN0QLfKSrZcd-i94MQR-bczycroD2TwO7aShD29dyw1atijMWxpkGQvLL205B8oNgcqcmvzSuVNKxb-hZ9GSKA3m2qhBfRG33LfCPhhGK-iTW71D6_0-F7OQ9w7kEOTi31PdC3XgaqhlqE Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 25c229f6a4574619a73b2780d2a6528b Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeTestJSON-1929180449 Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:15:23.357859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:15:23.359265 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:15:23.359265 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeTestJSON-1929180449 Sep 14 01:15:23.359265 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 25c229f6a4574619a73b2780d2a6528b Sep 14 01:15:23.359265 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1929180449 Sep 14 01:15:23.359265 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeTestJSON-1929180449-project Sep 14 01:15:23.359265 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:15:23.359265 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:15:23.359265 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: 2eca12e1e0a64eeeb183a328f338f54d Sep 14 01:15:23.359265 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeTestJSON-1929180449-project Sep 14 01:15:23.359265 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:15:23.359265 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Instance 0febaeca-9ac9-4094-b48f-06bca1b3903d could not be found. Sep 14 01:15:23.359265 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': '0febaeca-9ac9-4094-b48f-06bca1b3903d'} Sep 14 01:15:23.360078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:15:23.360078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:23.360078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:15:23.360078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:15:23.360078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:15:23.360078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:15:23.360078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:15:23.360078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:15:23.360078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:15:23.360078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:15:23.360078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0febaeca-9ac9-4094-b48f-06bca1b3903d could not be found. Sep 14 01:15:23.360078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:23.360078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:23.360078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:23.360078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:23.360078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:23.360078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:23.360078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:15:23.360078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:15:23.360078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:15:23.361284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:15:23.361284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:15:23.361284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:15:23.361284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:15:23.361284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:15:23.361284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:15:23.361284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:15:23.361284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0febaeca-9ac9-4094-b48f-06bca1b3903d could not be found. Sep 14 01:15:23.361284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:23.361284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:23.361284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:23.361284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:23.361284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:23.361284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:23.361284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:15:23.361284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:15:23.361284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0febaeca-9ac9-4094-b48f-06bca1b3903d could not be found. Sep 14 01:15:23.361284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:23.362346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fe94756e-f93d-4266-b5d0-9b094e945354 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Returning 404 to user: Instance 0febaeca-9ac9-4094-b48f-06bca1b3903d could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:15:23.362346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fe94756e-f93d-4266-b5d0-9b094e945354 tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d" status: 404 len: 111 microversion: 2.1 time: 0.033658 Sep 14 01:15:23.362346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 515/1037] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:23 2022] GET /compute/v2.1/servers/0febaeca-9ac9-4094-b48f-06bca1b3903d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:15:24.498757 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4ea3f9e8-26bc-498e-8d63-839ece7a5dda tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:24.499242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4ea3f9e8-26bc-498e-8d63-839ece7a5dda tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:24.505732 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4ea3f9e8-26bc-498e-8d63-839ece7a5dda tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:24.506477 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4ea3f9e8-26bc-498e-8d63-839ece7a5dda tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:24.506914 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4ea3f9e8-26bc-498e-8d63-839ece7a5dda tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:24.507632 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4ea3f9e8-26bc-498e-8d63-839ece7a5dda tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:24.508090 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4ea3f9e8-26bc-498e-8d63-839ece7a5dda tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:24.508515 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4ea3f9e8-26bc-498e-8d63-839ece7a5dda tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:24.521663 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-4ea3f9e8-26bc-498e-8d63-839ece7a5dda tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] HTTP exception thrown: Instance 5e701782-aa36-44dd-be23-a59054d8cb32 could not be found. Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4ea3f9e8-26bc-498e-8d63-839ece7a5dda tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Request method failure captured: Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: DELETE /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 HTTP/1.1 Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISi0xwKkVlqJjAxVxF7ZmdIDRsYSBScRRHN0QLfKSrZcd-i94MQR-bczycroD2TwO7aShD29dyw1atijMWxpkGQvLL205B8oNgcqcmvzSuVNKxb-hZ9GSKA3m2qhBfRG33LfCPhhGK-iTW71D6_0-F7OQ9w7kEOTi31PdC3XgaqhlqE Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 25c229f6a4574619a73b2780d2a6528b Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-AttachVolumeTestJSON-1929180449 Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:15:24.523219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:15:24.525154 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:15:24.525154 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-AttachVolumeTestJSON-1929180449 Sep 14 01:15:24.525154 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 25c229f6a4574619a73b2780d2a6528b Sep 14 01:15:24.525154 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1929180449 Sep 14 01:15:24.525154 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-AttachVolumeTestJSON-1929180449-project Sep 14 01:15:24.525154 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:15:24.525154 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:15:24.525154 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: 2eca12e1e0a64eeeb183a328f338f54d Sep 14 01:15:24.525154 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-AttachVolumeTestJSON-1929180449-project Sep 14 01:15:24.525154 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:15:24.525154 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance 5e701782-aa36-44dd-be23-a59054d8cb32 could not be found. Sep 14 01:15:24.525154 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': '5e701782-aa36-44dd-be23-a59054d8cb32'} Sep 14 01:15:24.526059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:15:24.526059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:24.526059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:15:24.526059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:15:24.526059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:15:24.526059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:15:24.526059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:15:24.526059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:15:24.526059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:15:24.526059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:15:24.526059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e701782-aa36-44dd-be23-a59054d8cb32 could not be found. Sep 14 01:15:24.526059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:24.526059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:24.526059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:24.526059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:24.526059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:24.526059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:24.526059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:15:24.526059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:15:24.526059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:15:24.527776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:15:24.527776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 01:15:24.527776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 01:15:24.527776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 01:15:24.527776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 01:15:24.527776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:15:24.527776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:15:24.527776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:15:24.527776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:15:24.527776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e701782-aa36-44dd-be23-a59054d8cb32 could not be found. Sep 14 01:15:24.527776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:24.527776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:24.527776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:24.527776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:24.527776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:24.527776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:24.527776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:15:24.527776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:15:24.527776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e701782-aa36-44dd-be23-a59054d8cb32 could not be found. Sep 14 01:15:24.527776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:24.529305 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4ea3f9e8-26bc-498e-8d63-839ece7a5dda tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Returning 404 to user: Instance 5e701782-aa36-44dd-be23-a59054d8cb32 could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:15:24.529305 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4ea3f9e8-26bc-498e-8d63-839ece7a5dda tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 404 len: 111 microversion: 2.1 time: 0.029761 Sep 14 01:15:24.529305 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 523/1038] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:15:24 2022] DELETE /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 01:15:24.533040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9f706ad6-faf3-4dc5-967c-67727426d0de tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:24.533650 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9f706ad6-faf3-4dc5-967c-67727426d0de tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] [instance: 5e701782-aa36-44dd-be23-a59054d8cb32] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:24.542793 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9f706ad6-faf3-4dc5-967c-67727426d0de tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:24.543277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9f706ad6-faf3-4dc5-967c-67727426d0de tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:24.543827 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9f706ad6-faf3-4dc5-967c-67727426d0de tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:24.544519 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9f706ad6-faf3-4dc5-967c-67727426d0de tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:24.544973 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9f706ad6-faf3-4dc5-967c-67727426d0de tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:24.545397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9f706ad6-faf3-4dc5-967c-67727426d0de tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:24.559176 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-9f706ad6-faf3-4dc5-967c-67727426d0de tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] HTTP exception thrown: Instance 5e701782-aa36-44dd-be23-a59054d8cb32 could not be found. Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9f706ad6-faf3-4dc5-967c-67727426d0de tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Request method failure captured: Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 HTTP/1.1 Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISi0xwKkVlqJjAxVxF7ZmdIDRsYSBScRRHN0QLfKSrZcd-i94MQR-bczycroD2TwO7aShD29dyw1atijMWxpkGQvLL205B8oNgcqcmvzSuVNKxb-hZ9GSKA3m2qhBfRG33LfCPhhGK-iTW71D6_0-F7OQ9w7kEOTi31PdC3XgaqhlqE Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 25c229f6a4574619a73b2780d2a6528b Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeTestJSON-1929180449 Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:15:24.560723 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:15:24.562284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_25c229f6a4574619a73b2780d2a6528b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:15:24.562284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeTestJSON-1929180449 Sep 14 01:15:24.562284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 25c229f6a4574619a73b2780d2a6528b Sep 14 01:15:24.562284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1929180449 Sep 14 01:15:24.562284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeTestJSON-1929180449-project Sep 14 01:15:24.562284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:15:24.562284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:15:24.562284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: 2eca12e1e0a64eeeb183a328f338f54d Sep 14 01:15:24.562284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeTestJSON-1929180449-project Sep 14 01:15:24.562284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:15:24.562284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Instance 5e701782-aa36-44dd-be23-a59054d8cb32 could not be found. Sep 14 01:15:24.562284 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': '5e701782-aa36-44dd-be23-a59054d8cb32'} Sep 14 01:15:24.563153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:15:24.563153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:24.563153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:15:24.563153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:15:24.563153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:15:24.563153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:15:24.563153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:15:24.563153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:15:24.563153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:15:24.563153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:15:24.563153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e701782-aa36-44dd-be23-a59054d8cb32 could not be found. Sep 14 01:15:24.563153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:24.563153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:24.563153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:24.563153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:24.563153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:24.563153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:24.563153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:15:24.563153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:15:24.563153 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:15:24.564404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:15:24.564404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:15:24.564404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:15:24.564404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:15:24.564404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:15:24.564404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:15:24.564404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:15:24.564404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e701782-aa36-44dd-be23-a59054d8cb32 could not be found. Sep 14 01:15:24.564404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:24.564404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:24.564404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:24.564404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:24.564404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:24.564404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:24.564404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:15:24.564404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:15:24.564404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e701782-aa36-44dd-be23-a59054d8cb32 could not be found. Sep 14 01:15:24.564404 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:24.565497 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9f706ad6-faf3-4dc5-967c-67727426d0de tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] Returning 404 to user: Instance 5e701782-aa36-44dd-be23-a59054d8cb32 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:15:24.565497 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9f706ad6-faf3-4dc5-967c-67727426d0de tempest-AttachVolumeTestJSON-1929180449 tempest-AttachVolumeTestJSON-1929180449-project] 10.222.0.42 "GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32" status: 404 len: 111 microversion: 2.1 time: 0.032968 Sep 14 01:15:24.565497 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 516/1039] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:24 2022] GET /compute/v2.1/servers/5e701782-aa36-44dd-be23-a59054d8cb32 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 01:15:29.021549 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d1a1d2b8-5904-45a7-a1d1-c786d99d8e6d tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] Action: 'create', calling method: .version_select at 0x7f504b6c1af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2102986903", "metadata": {"Type": "work"}}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d1a1d2b8-5904-45a7-a1d1-c786d99d8e6d tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] Request method failure captured: Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 122 Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISswriHmXXKr9pD1u38X7tRxZvIREnFF6xbghSBUB1ZlkLzgn1loW5A6EAT1Rh39IxD3a_sUlTF7cFIknfAdPhnH3LWy1OgqfURYrR9jd0SwBsTx_QJpeqBiET4GG0pVJj1SBD5YzTYSz65NRvDtA_eiCk7tpw_6k1FP4WZyukWmjJM Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 98477d8315ec4a13bbef225588d7710c Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-VolumesNegativeTest-424100406 Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:15:29.030880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:15:29.032522 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/98477d8315ec4a13bbef225588d7710c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/98477d8315ec4a13bbef225588d7710c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/98477d8315ec4a13bbef225588d7710c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_98477d8315ec4a13bbef225588d7710c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:15:29.032522 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-VolumesNegativeTest-424100406 Sep 14 01:15:29.032522 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 98477d8315ec4a13bbef225588d7710c Sep 14 01:15:29.032522 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-VolumesNegativeTest-424100406 Sep 14 01:15:29.032522 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-VolumesNegativeTest-424100406-project Sep 14 01:15:29.032522 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:15:29.032522 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:15:29.032522 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: dc066a127f89458ab05539e0a28872e6 Sep 14 01:15:29.032522 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-VolumesNegativeTest-424100406-project Sep 14 01:15:29.032522 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Sep 14 01:15:29.032522 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2102986903", "metadata": {"Type": "work"}}} Sep 14 01:15:29.032522 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: Sep 14 01:15:29.032522 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2102986903', 'metadata': {'Type': 'work'}}}} Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise error Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi '#$%' Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:15:29.033583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:15:29.035228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 01:15:29.035228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 01:15:29.035228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:15:29.035228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:15:29.035228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 01:15:29.035228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 01:15:29.035228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 01:15:29.035228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 01:15:29.035228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 01:15:29.035228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 01:15:29.035228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 14 01:15:29.035228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.035228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:29.035228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.035228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.035228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:29.035228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:29.035228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 01:15:29.035228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 01:15:29.036657 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 14 01:15:29.036657 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.036657 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d1a1d2b8-5904-45a7-a1d1-c786d99d8e6d tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:15:29.036657 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d1a1d2b8-5904-45a7-a1d1-c786d99d8e6d tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.122659 Sep 14 01:15:29.036657 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 524/1040] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Sep 14 01:15:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 01:15:29.043362 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-357aecbf-f6ca-47eb-b8d9-d197eaf7543b tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] Action: 'create', calling method: .version_select at 0x7f5043ea3ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-957141666", "metadata": {"Type": "work"}}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-357aecbf-f6ca-47eb-b8d9-d197eaf7543b tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] Request method failure captured: Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 119 Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISswriHmXXKr9pD1u38X7tRxZvIREnFF6xbghSBUB1ZlkLzgn1loW5A6EAT1Rh39IxD3a_sUlTF7cFIknfAdPhnH3LWy1OgqfURYrR9jd0SwBsTx_QJpeqBiET4GG0pVJj1SBD5YzTYSz65NRvDtA_eiCk7tpw_6k1FP4WZyukWmjJM Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 98477d8315ec4a13bbef225588d7710c Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-VolumesNegativeTest-424100406 Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:15:29.047867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:15:29.049501 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/98477d8315ec4a13bbef225588d7710c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/98477d8315ec4a13bbef225588d7710c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/98477d8315ec4a13bbef225588d7710c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_98477d8315ec4a13bbef225588d7710c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:15:29.049501 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-VolumesNegativeTest-424100406 Sep 14 01:15:29.049501 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 98477d8315ec4a13bbef225588d7710c Sep 14 01:15:29.049501 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-VolumesNegativeTest-424100406 Sep 14 01:15:29.049501 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-VolumesNegativeTest-424100406-project Sep 14 01:15:29.049501 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:15:29.049501 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:15:29.049501 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: dc066a127f89458ab05539e0a28872e6 Sep 14 01:15:29.049501 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-VolumesNegativeTest-424100406-project Sep 14 01:15:29.049501 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Sep 14 01:15:29.049501 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-957141666", "metadata": {"Type": "work"}}} Sep 14 01:15:29.049501 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: Sep 14 01:15:29.049501 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-957141666', 'metadata': {'Type': 'work'}}}} Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise error Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi '0' Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:15:29.050524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:15:29.052346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 01:15:29.052346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 01:15:29.052346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:15:29.052346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:15:29.052346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 01:15:29.052346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 01:15:29.052346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 01:15:29.052346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 01:15:29.052346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 01:15:29.052346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 01:15:29.052346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 14 01:15:29.052346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.052346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:29.052346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.052346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.052346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:29.052346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:29.052346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 01:15:29.052346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 01:15:29.054027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 14 01:15:29.054027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.054027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-357aecbf-f6ca-47eb-b8d9-d197eaf7543b tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:15:29.054027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-357aecbf-f6ca-47eb-b8d9-d197eaf7543b tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010506 Sep 14 01:15:29.054027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 517/1041] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Sep 14 01:15:29 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 01:15:29.058904 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e503dcc2-8012-4881-a15e-59897d869aae tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] Action: 'create', calling method: .version_select at 0x7f5048096280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-62231989", "metadata": {"Type": "work"}}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e503dcc2-8012-4881-a15e-59897d869aae tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] Request method failure captured: Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 117 Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISswriHmXXKr9pD1u38X7tRxZvIREnFF6xbghSBUB1ZlkLzgn1loW5A6EAT1Rh39IxD3a_sUlTF7cFIknfAdPhnH3LWy1OgqfURYrR9jd0SwBsTx_QJpeqBiET4GG0pVJj1SBD5YzTYSz65NRvDtA_eiCk7tpw_6k1FP4WZyukWmjJM Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 98477d8315ec4a13bbef225588d7710c Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-VolumesNegativeTest-424100406 Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:15:29.063767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:15:29.065325 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/98477d8315ec4a13bbef225588d7710c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/98477d8315ec4a13bbef225588d7710c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/98477d8315ec4a13bbef225588d7710c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_98477d8315ec4a13bbef225588d7710c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:15:29.065325 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-VolumesNegativeTest-424100406 Sep 14 01:15:29.065325 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 98477d8315ec4a13bbef225588d7710c Sep 14 01:15:29.065325 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-VolumesNegativeTest-424100406 Sep 14 01:15:29.065325 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-VolumesNegativeTest-424100406-project Sep 14 01:15:29.065325 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:15:29.065325 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:15:29.065325 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: dc066a127f89458ab05539e0a28872e6 Sep 14 01:15:29.065325 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-VolumesNegativeTest-424100406-project Sep 14 01:15:29.065325 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Sep 14 01:15:29.065325 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-62231989", "metadata": {"Type": "work"}}} Sep 14 01:15:29.065325 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: Sep 14 01:15:29.065325 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-62231989', 'metadata': {'Type': 'work'}}}} Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise error Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi '' Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:15:29.066242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:15:29.067867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 01:15:29.067867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 01:15:29.067867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:15:29.067867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:15:29.067867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 01:15:29.067867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 01:15:29.067867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 01:15:29.067867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 01:15:29.067867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 01:15:29.067867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 01:15:29.067867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 14 01:15:29.067867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.067867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:29.067867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.067867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.067867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:29.067867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:29.067867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 01:15:29.067867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 01:15:29.069091 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 14 01:15:29.069091 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.069091 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-e503dcc2-8012-4881-a15e-59897d869aae tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:15:29.069091 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-e503dcc2-8012-4881-a15e-59897d869aae tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010729 Sep 14 01:15:29.069091 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 525/1042] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Sep 14 01:15:29 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 01:15:29.075602 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-dc52b7f8-e3b0-40a9-a794-61d7d8f3f919 tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] Calling method '.version_select at 0x7f5043e20ee0>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:29.105861 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-dc52b7f8-e3b0-40a9-a794-61d7d8f3f919 tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] HTTP exception thrown: Volume tempest-invalid-653135277 could not be found. Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-dc52b7f8-e3b0-40a9-a794-61d7d8f3f919 tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] Request method failure captured: Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-653135277 HTTP/1.1 Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISswriHmXXKr9pD1u38X7tRxZvIREnFF6xbghSBUB1ZlkLzgn1loW5A6EAT1Rh39IxD3a_sUlTF7cFIknfAdPhnH3LWy1OgqfURYrR9jd0SwBsTx_QJpeqBiET4GG0pVJj1SBD5YzTYSz65NRvDtA_eiCk7tpw_6k1FP4WZyukWmjJM Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 98477d8315ec4a13bbef225588d7710c Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-VolumesNegativeTest-424100406 Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:15:29.107869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:15:29.109407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/98477d8315ec4a13bbef225588d7710c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/98477d8315ec4a13bbef225588d7710c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/98477d8315ec4a13bbef225588d7710c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_98477d8315ec4a13bbef225588d7710c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:15:29.109407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-VolumesNegativeTest-424100406 Sep 14 01:15:29.109407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 98477d8315ec4a13bbef225588d7710c Sep 14 01:15:29.109407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-VolumesNegativeTest-424100406 Sep 14 01:15:29.109407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-VolumesNegativeTest-424100406-project Sep 14 01:15:29.109407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:15:29.109407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:15:29.109407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: dc066a127f89458ab05539e0a28872e6 Sep 14 01:15:29.109407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-VolumesNegativeTest-424100406-project Sep 14 01:15:29.109407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: Sep 14 01:15:29.109407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Volume tempest-invalid-653135277 could not be found. Sep 14 01:15:29.109407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': 'tempest-invalid-653135277'} Sep 14 01:15:29.109407 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:15:29.110411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.110411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 01:15:29.110411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 01:15:29.110411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 01:15:29.110411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 01:15:29.110411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 01:15:29.110411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 01:15:29.110411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 01:15:29.110411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 01:15:29.110411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 01:15:29.110411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 01:15:29.110411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 01:15:29.110411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 01:15:29.110411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 01:15:29.110411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 01:15:29.110411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-653135277 could not be found. (HTTP 404) (Request-ID: req-3b9709a4-ee54-4cf2-b5b9-09ba4a471289) Sep 14 01:15:29.110411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.110411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:29.110411 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.111883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.111883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 14 01:15:29.111883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 14 01:15:29.111883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 01:15:29.111883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 01:15:29.111883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 01:15:29.111883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 01:15:29.111883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 01:15:29.111883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 01:15:29.111883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 01:15:29.111883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 01:15:29.111883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 01:15:29.111883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 01:15:29.111883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 01:15:29.111883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 01:15:29.111883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 01:15:29.111883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 01:15:29.111883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 01:15:29.111883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 01:15:29.113283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 01:15:29.113283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 01:15:29.113283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 01:15:29.113283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 01:15:29.113283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-653135277 could not be found. Sep 14 01:15:29.113283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.113283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:29.113283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.113283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.113283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:29.113283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:29.113283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:15:29.113283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:15:29.113283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 01:15:29.113283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 01:15:29.113283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:15:29.113283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:15:29.113283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 14 01:15:29.113283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:15:29.113283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-653135277 could not be found. Sep 14 01:15:29.114813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.114813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:29.114813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.114813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.114813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:29.114813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:29.114813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:15:29.114813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:15:29.114813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-653135277 could not be found. Sep 14 01:15:29.114813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.114813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-dc52b7f8-e3b0-40a9-a794-61d7d8f3f919 tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] Returning 404 to user: Volume tempest-invalid-653135277 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:15:29.114813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-dc52b7f8-e3b0-40a9-a794-61d7d8f3f919 tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-653135277" status: 404 len: 98 microversion: 2.1 time: 0.038630 Sep 14 01:15:29.114813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 518/1043] 10.222.0.42 () {58 vars in 1215 bytes} [Wed Sep 14 01:15:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-653135277 => generated 98 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 01:15:29.120656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8cb5edb1-8e12-4ab8-8307-b4fdc81a3c2e tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004608 Sep 14 01:15:29.121155 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 526/1044] 10.222.0.42 () {58 vars in 1140 bytes} [Wed Sep 14 01:15:29 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 14 01:15:29.129060 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ae05fe46-6784-48d9-b112-2eb3da733d66 tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003636 Sep 14 01:15:29.129538 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 519/1045] 10.222.0.42 () {58 vars in 1137 bytes} [Wed Sep 14 01:15:29 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 14 01:15:29.137894 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-89255039-6435-4b87-9db3-4d25f8950cde tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] Calling method '.version_select at 0x7f504803e1f0>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:29.166145 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-89255039-6435-4b87-9db3-4d25f8950cde tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] HTTP exception thrown: Volume cd5b78f3-99ff-4ee7-b2dc-50e8adf08d88 could not be found. Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-89255039-6435-4b87-9db3-4d25f8950cde tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] Request method failure captured: Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: DELETE /compute/v2.1/os-volumes/cd5b78f3-99ff-4ee7-b2dc-50e8adf08d88 HTTP/1.1 Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISswriHmXXKr9pD1u38X7tRxZvIREnFF6xbghSBUB1ZlkLzgn1loW5A6EAT1Rh39IxD3a_sUlTF7cFIknfAdPhnH3LWy1OgqfURYrR9jd0SwBsTx_QJpeqBiET4GG0pVJj1SBD5YzTYSz65NRvDtA_eiCk7tpw_6k1FP4WZyukWmjJM Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 98477d8315ec4a13bbef225588d7710c Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-VolumesNegativeTest-424100406 Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:15:29.168086 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:15:29.169652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/98477d8315ec4a13bbef225588d7710c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/98477d8315ec4a13bbef225588d7710c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/98477d8315ec4a13bbef225588d7710c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_98477d8315ec4a13bbef225588d7710c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:15:29.169652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-VolumesNegativeTest-424100406 Sep 14 01:15:29.169652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 98477d8315ec4a13bbef225588d7710c Sep 14 01:15:29.169652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-VolumesNegativeTest-424100406 Sep 14 01:15:29.169652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-VolumesNegativeTest-424100406-project Sep 14 01:15:29.169652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:15:29.169652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:15:29.169652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: dc066a127f89458ab05539e0a28872e6 Sep 14 01:15:29.169652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-VolumesNegativeTest-424100406-project Sep 14 01:15:29.169652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: Sep 14 01:15:29.169652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Volume cd5b78f3-99ff-4ee7-b2dc-50e8adf08d88 could not be found. Sep 14 01:15:29.169652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': 'cd5b78f3-99ff-4ee7-b2dc-50e8adf08d88'} Sep 14 01:15:29.169652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:15:29.170527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.170527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 01:15:29.170527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 01:15:29.170527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 01:15:29.170527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 01:15:29.170527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 01:15:29.170527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 01:15:29.170527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 01:15:29.170527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 01:15:29.170527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 01:15:29.170527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 01:15:29.170527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 01:15:29.170527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 01:15:29.170527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 01:15:29.170527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 01:15:29.170527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cd5b78f3-99ff-4ee7-b2dc-50e8adf08d88 could not be found. (HTTP 404) (Request-ID: req-36dabe9b-7452-4d83-a591-e617648ef7d9) Sep 14 01:15:29.170527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.170527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:29.170527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.171957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.171957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 14 01:15:29.171957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 14 01:15:29.171957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 01:15:29.171957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 01:15:29.171957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 01:15:29.171957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 01:15:29.171957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 01:15:29.171957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 01:15:29.171957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 01:15:29.171957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 01:15:29.171957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 01:15:29.171957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 01:15:29.171957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 01:15:29.171957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 01:15:29.171957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 01:15:29.171957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 01:15:29.171957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 01:15:29.171957 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 01:15:29.173436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 01:15:29.173436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 01:15:29.173436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 01:15:29.173436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 01:15:29.173436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cd5b78f3-99ff-4ee7-b2dc-50e8adf08d88 could not be found. Sep 14 01:15:29.173436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.173436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:29.173436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.173436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.173436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:29.173436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:29.173436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:15:29.173436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:15:29.173436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 01:15:29.173436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 01:15:29.173436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:15:29.173436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:15:29.173436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 14 01:15:29.173436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:15:29.174876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cd5b78f3-99ff-4ee7-b2dc-50e8adf08d88 could not be found. Sep 14 01:15:29.174876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.174876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:29.174876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.174876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.174876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:29.174876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:29.174876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:15:29.174876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:15:29.174876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cd5b78f3-99ff-4ee7-b2dc-50e8adf08d88 could not be found. Sep 14 01:15:29.174876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.174876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-89255039-6435-4b87-9db3-4d25f8950cde tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] Returning 404 to user: Volume cd5b78f3-99ff-4ee7-b2dc-50e8adf08d88 could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:15:29.174876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-89255039-6435-4b87-9db3-4d25f8950cde tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/cd5b78f3-99ff-4ee7-b2dc-50e8adf08d88" status: 404 len: 109 microversion: 2.1 time: 0.035363 Sep 14 01:15:29.174876 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 527/1046] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Sep 14 01:15:29 2022] DELETE /compute/v2.1/os-volumes/cd5b78f3-99ff-4ee7-b2dc-50e8adf08d88 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 01:15:29.179672 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0ca986a8-8758-49d3-bb94-29d82d61c30e tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] Calling method '.version_select at 0x7f5043d77d30>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:29.207349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-0ca986a8-8758-49d3-bb94-29d82d61c30e tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] HTTP exception thrown: Volume d0bd0eed-a9c0-4dcc-95f9-3a45fb9e2ff5 could not be found. Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0ca986a8-8758-49d3-bb94-29d82d61c30e tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] Request method failure captured: Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/os-volumes/d0bd0eed-a9c0-4dcc-95f9-3a45fb9e2ff5 HTTP/1.1 Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISswriHmXXKr9pD1u38X7tRxZvIREnFF6xbghSBUB1ZlkLzgn1loW5A6EAT1Rh39IxD3a_sUlTF7cFIknfAdPhnH3LWy1OgqfURYrR9jd0SwBsTx_QJpeqBiET4GG0pVJj1SBD5YzTYSz65NRvDtA_eiCk7tpw_6k1FP4WZyukWmjJM Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 98477d8315ec4a13bbef225588d7710c Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-VolumesNegativeTest-424100406 Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:15:29.209285 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:15:29.210877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/98477d8315ec4a13bbef225588d7710c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/98477d8315ec4a13bbef225588d7710c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/98477d8315ec4a13bbef225588d7710c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_98477d8315ec4a13bbef225588d7710c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:15:29.210877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-VolumesNegativeTest-424100406 Sep 14 01:15:29.210877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 98477d8315ec4a13bbef225588d7710c Sep 14 01:15:29.210877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-VolumesNegativeTest-424100406 Sep 14 01:15:29.210877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-VolumesNegativeTest-424100406-project Sep 14 01:15:29.210877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:15:29.210877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:15:29.210877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: dc066a127f89458ab05539e0a28872e6 Sep 14 01:15:29.210877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-VolumesNegativeTest-424100406-project Sep 14 01:15:29.210877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: Sep 14 01:15:29.210877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Volume d0bd0eed-a9c0-4dcc-95f9-3a45fb9e2ff5 could not be found. Sep 14 01:15:29.210877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': 'd0bd0eed-a9c0-4dcc-95f9-3a45fb9e2ff5'} Sep 14 01:15:29.210877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:15:29.212034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.212034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 01:15:29.212034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 01:15:29.212034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 01:15:29.212034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 01:15:29.212034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 01:15:29.212034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 01:15:29.212034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 01:15:29.212034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 01:15:29.212034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 01:15:29.212034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 01:15:29.212034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 01:15:29.212034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 01:15:29.212034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 01:15:29.212034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 01:15:29.212034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0bd0eed-a9c0-4dcc-95f9-3a45fb9e2ff5 could not be found. (HTTP 404) (Request-ID: req-5f8d677a-8301-4875-8b0c-9dfd6cef3350) Sep 14 01:15:29.212034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.212034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:29.212034 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.213211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.213211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 14 01:15:29.213211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 14 01:15:29.213211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 01:15:29.213211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 01:15:29.213211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 01:15:29.213211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 01:15:29.213211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 01:15:29.213211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 01:15:29.213211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 01:15:29.213211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 01:15:29.213211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 01:15:29.213211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 01:15:29.213211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 01:15:29.213211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 01:15:29.213211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 01:15:29.213211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 01:15:29.213211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 01:15:29.213211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 01:15:29.214349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 01:15:29.214349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 01:15:29.214349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 01:15:29.214349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 01:15:29.214349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0bd0eed-a9c0-4dcc-95f9-3a45fb9e2ff5 could not be found. Sep 14 01:15:29.214349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.214349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:29.214349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.214349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.214349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:29.214349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:29.214349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:15:29.214349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:15:29.214349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 01:15:29.214349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 01:15:29.214349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:15:29.214349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:15:29.214349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 14 01:15:29.214349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:15:29.215635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0bd0eed-a9c0-4dcc-95f9-3a45fb9e2ff5 could not be found. Sep 14 01:15:29.215635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.215635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:15:29.215635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.215635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:15:29.215635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:15:29.215635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:15:29.215635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:15:29.215635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:15:29.215635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0bd0eed-a9c0-4dcc-95f9-3a45fb9e2ff5 could not be found. Sep 14 01:15:29.215635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:15:29.215635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0ca986a8-8758-49d3-bb94-29d82d61c30e tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] Returning 404 to user: Volume d0bd0eed-a9c0-4dcc-95f9-3a45fb9e2ff5 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:15:29.215635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0ca986a8-8758-49d3-bb94-29d82d61c30e tempest-VolumesNegativeTest-424100406 tempest-VolumesNegativeTest-424100406-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d0bd0eed-a9c0-4dcc-95f9-3a45fb9e2ff5" status: 404 len: 109 microversion: 2.1 time: 0.034755 Sep 14 01:15:29.215635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 520/1047] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 01:15:29 2022] GET /compute/v2.1/os-volumes/d0bd0eed-a9c0-4dcc-95f9-3a45fb9e2ff5 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:15:30.664692 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-cf6ec3af-a820-4e0d-b2ef-bd09f479d67d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:15:30.667377 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-cf6ec3af-a820-4e0d-b2ef-bd09f479d67d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:30.673771 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cf6ec3af-a820-4e0d-b2ef-bd09f479d67d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:30.674341 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cf6ec3af-a820-4e0d-b2ef-bd09f479d67d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:30.674699 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cf6ec3af-a820-4e0d-b2ef-bd09f479d67d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:30.675754 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cf6ec3af-a820-4e0d-b2ef-bd09f479d67d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:30.676297 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cf6ec3af-a820-4e0d-b2ef-bd09f479d67d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:30.676724 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-cf6ec3af-a820-4e0d-b2ef-bd09f479d67d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:30.757302 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-cf6ec3af-a820-4e0d-b2ef-bd09f479d67d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "POST /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/action" status: 202 len: 0 microversion: 2.1 time: 0.098131 Sep 14 01:15:30.757923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 528/1048] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 01:15:30 2022] POST /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:15:30.768023 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0d54b5d4-a1d8-4fff-8f91-e69bfaffdcc1 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:30.768755 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0d54b5d4-a1d8-4fff-8f91-e69bfaffdcc1 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:30.776592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0d54b5d4-a1d8-4fff-8f91-e69bfaffdcc1 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:30.777322 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0d54b5d4-a1d8-4fff-8f91-e69bfaffdcc1 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:30.777750 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0d54b5d4-a1d8-4fff-8f91-e69bfaffdcc1 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:30.778554 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0d54b5d4-a1d8-4fff-8f91-e69bfaffdcc1 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:30.779084 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0d54b5d4-a1d8-4fff-8f91-e69bfaffdcc1 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:30.779433 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0d54b5d4-a1d8-4fff-8f91-e69bfaffdcc1 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:30.940875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0d54b5d4-a1d8-4fff-8f91-e69bfaffdcc1 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:30.950631 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0d54b5d4-a1d8-4fff-8f91-e69bfaffdcc1 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1751 microversion: 2.1 time: 0.187708 Sep 14 01:15:30.951204 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 521/1049] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:30 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:15:31.978404 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-c6f21d87-6f8b-4d97-ac18-853198ca3a43 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:31.979343 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-c6f21d87-6f8b-4d97-ac18-853198ca3a43 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:31.985746 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c6f21d87-6f8b-4d97-ac18-853198ca3a43 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:31.986227 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c6f21d87-6f8b-4d97-ac18-853198ca3a43 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:31.986660 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c6f21d87-6f8b-4d97-ac18-853198ca3a43 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:31.987345 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c6f21d87-6f8b-4d97-ac18-853198ca3a43 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:31.987828 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c6f21d87-6f8b-4d97-ac18-853198ca3a43 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:31.988245 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c6f21d87-6f8b-4d97-ac18-853198ca3a43 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:32.138216 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c6f21d87-6f8b-4d97-ac18-853198ca3a43 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:32.146577 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-c6f21d87-6f8b-4d97-ac18-853198ca3a43 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1756 microversion: 2.1 time: 0.174798 Sep 14 01:15:32.159653 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 529/1050] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:31 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:15:33.171690 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3a419d88-e8fc-4df8-9e4e-59fbebd7e199 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:33.172296 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3a419d88-e8fc-4df8-9e4e-59fbebd7e199 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:33.178934 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3a419d88-e8fc-4df8-9e4e-59fbebd7e199 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:33.179402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3a419d88-e8fc-4df8-9e4e-59fbebd7e199 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:33.179863 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3a419d88-e8fc-4df8-9e4e-59fbebd7e199 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:33.180606 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3a419d88-e8fc-4df8-9e4e-59fbebd7e199 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:33.181112 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3a419d88-e8fc-4df8-9e4e-59fbebd7e199 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:33.181533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3a419d88-e8fc-4df8-9e4e-59fbebd7e199 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:33.332528 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-3a419d88-e8fc-4df8-9e4e-59fbebd7e199 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:33.341464 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3a419d88-e8fc-4df8-9e4e-59fbebd7e199 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1756 microversion: 2.1 time: 0.173637 Sep 14 01:15:33.342383 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 522/1051] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:33 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:15:34.366267 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-261f9cd7-15e1-42f6-9622-ffdbc94ddcc6 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:34.366818 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-261f9cd7-15e1-42f6-9622-ffdbc94ddcc6 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:34.373417 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-261f9cd7-15e1-42f6-9622-ffdbc94ddcc6 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:34.374136 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-261f9cd7-15e1-42f6-9622-ffdbc94ddcc6 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:34.374348 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-261f9cd7-15e1-42f6-9622-ffdbc94ddcc6 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:34.375051 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-261f9cd7-15e1-42f6-9622-ffdbc94ddcc6 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:34.375506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-261f9cd7-15e1-42f6-9622-ffdbc94ddcc6 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:34.376064 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-261f9cd7-15e1-42f6-9622-ffdbc94ddcc6 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:34.523162 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-261f9cd7-15e1-42f6-9622-ffdbc94ddcc6 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:34.531851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-261f9cd7-15e1-42f6-9622-ffdbc94ddcc6 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1756 microversion: 2.1 time: 0.169524 Sep 14 01:15:34.532408 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 530/1052] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:34 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:15:35.555516 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-319c066c-197f-4cac-ba29-d665fae38ea7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:35.556167 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-319c066c-197f-4cac-ba29-d665fae38ea7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:35.562748 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-319c066c-197f-4cac-ba29-d665fae38ea7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:35.563223 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-319c066c-197f-4cac-ba29-d665fae38ea7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:35.563696 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-319c066c-197f-4cac-ba29-d665fae38ea7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:35.564378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-319c066c-197f-4cac-ba29-d665fae38ea7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:35.564824 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-319c066c-197f-4cac-ba29-d665fae38ea7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:35.565239 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-319c066c-197f-4cac-ba29-d665fae38ea7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:35.706280 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-319c066c-197f-4cac-ba29-d665fae38ea7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:35.715037 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-319c066c-197f-4cac-ba29-d665fae38ea7 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1756 microversion: 2.1 time: 0.163575 Sep 14 01:15:35.715608 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 523/1053] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:35 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:15:36.738186 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-27472d00-8cb6-4b30-aef6-8008fca29278 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:36.738890 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-27472d00-8cb6-4b30-aef6-8008fca29278 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:36.745501 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-27472d00-8cb6-4b30-aef6-8008fca29278 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:36.745983 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-27472d00-8cb6-4b30-aef6-8008fca29278 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:36.746421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-27472d00-8cb6-4b30-aef6-8008fca29278 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:36.747116 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-27472d00-8cb6-4b30-aef6-8008fca29278 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:36.747619 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-27472d00-8cb6-4b30-aef6-8008fca29278 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:36.748043 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-27472d00-8cb6-4b30-aef6-8008fca29278 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:36.888665 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-27472d00-8cb6-4b30-aef6-8008fca29278 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:36.896720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-27472d00-8cb6-4b30-aef6-8008fca29278 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1756 microversion: 2.1 time: 0.162474 Sep 14 01:15:36.897288 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 531/1054] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:36 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:15:37.921233 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-123972f9-e890-48c8-9f3d-3483a7a30a36 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:37.921863 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-123972f9-e890-48c8-9f3d-3483a7a30a36 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:37.928170 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-123972f9-e890-48c8-9f3d-3483a7a30a36 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:37.928645 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-123972f9-e890-48c8-9f3d-3483a7a30a36 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:37.929074 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-123972f9-e890-48c8-9f3d-3483a7a30a36 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:37.929746 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-123972f9-e890-48c8-9f3d-3483a7a30a36 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:37.930226 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-123972f9-e890-48c8-9f3d-3483a7a30a36 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:37.930642 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-123972f9-e890-48c8-9f3d-3483a7a30a36 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:38.073118 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-123972f9-e890-48c8-9f3d-3483a7a30a36 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:38.081394 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-123972f9-e890-48c8-9f3d-3483a7a30a36 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1756 microversion: 2.1 time: 0.164955 Sep 14 01:15:38.081951 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 524/1055] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:37 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:15:39.104498 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7ea6c0b9-5d4c-497b-9736-0960ddcb315c tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:39.105070 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7ea6c0b9-5d4c-497b-9736-0960ddcb315c tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:39.111762 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ea6c0b9-5d4c-497b-9736-0960ddcb315c tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:39.112248 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ea6c0b9-5d4c-497b-9736-0960ddcb315c tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:39.112684 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ea6c0b9-5d4c-497b-9736-0960ddcb315c tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:39.113374 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ea6c0b9-5d4c-497b-9736-0960ddcb315c tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:39.113831 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ea6c0b9-5d4c-497b-9736-0960ddcb315c tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:39.114262 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ea6c0b9-5d4c-497b-9736-0960ddcb315c tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:39.262610 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7ea6c0b9-5d4c-497b-9736-0960ddcb315c tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:39.270887 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7ea6c0b9-5d4c-497b-9736-0960ddcb315c tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1756 microversion: 2.1 time: 0.170340 Sep 14 01:15:39.271451 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 532/1056] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:39 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:15:40.295233 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7f842341-396f-4e0c-be3d-7d12241f0f19 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:40.295913 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7f842341-396f-4e0c-be3d-7d12241f0f19 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:40.303459 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7f842341-396f-4e0c-be3d-7d12241f0f19 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:40.304399 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7f842341-396f-4e0c-be3d-7d12241f0f19 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:40.304888 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7f842341-396f-4e0c-be3d-7d12241f0f19 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:40.305631 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7f842341-396f-4e0c-be3d-7d12241f0f19 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:40.306094 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7f842341-396f-4e0c-be3d-7d12241f0f19 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:40.306525 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7f842341-396f-4e0c-be3d-7d12241f0f19 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:40.474588 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7f842341-396f-4e0c-be3d-7d12241f0f19 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:40.491622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7f842341-396f-4e0c-be3d-7d12241f0f19 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1756 microversion: 2.1 time: 0.200421 Sep 14 01:15:40.492217 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 525/1057] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:40 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:15:41.517740 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a8aa1505-e923-4f33-a620-81bcd33ef74a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:41.518453 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a8aa1505-e923-4f33-a620-81bcd33ef74a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:41.520864 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:15:41.526424 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a8aa1505-e923-4f33-a620-81bcd33ef74a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:41.527447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a8aa1505-e923-4f33-a620-81bcd33ef74a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:41.527919 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a8aa1505-e923-4f33-a620-81bcd33ef74a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:41.528603 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a8aa1505-e923-4f33-a620-81bcd33ef74a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:41.529062 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a8aa1505-e923-4f33-a620-81bcd33ef74a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:41.529490 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a8aa1505-e923-4f33-a620-81bcd33ef74a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:41.677499 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a8aa1505-e923-4f33-a620-81bcd33ef74a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:41.683589 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a8aa1505-e923-4f33-a620-81bcd33ef74a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1756 microversion: 2.1 time: 0.169832 Sep 14 01:15:41.684194 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 533/1058] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:41 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:15:42.707774 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c2b2c11a-68ac-4348-b27a-17117c22bc13 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:42.708605 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c2b2c11a-68ac-4348-b27a-17117c22bc13 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:42.715079 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2b2c11a-68ac-4348-b27a-17117c22bc13 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:42.715580 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2b2c11a-68ac-4348-b27a-17117c22bc13 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:42.716041 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2b2c11a-68ac-4348-b27a-17117c22bc13 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:42.716754 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2b2c11a-68ac-4348-b27a-17117c22bc13 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:42.717272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2b2c11a-68ac-4348-b27a-17117c22bc13 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:42.717716 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c2b2c11a-68ac-4348-b27a-17117c22bc13 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:42.861080 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c2b2c11a-68ac-4348-b27a-17117c22bc13 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:42.869434 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c2b2c11a-68ac-4348-b27a-17117c22bc13 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1756 microversion: 2.1 time: 0.166024 Sep 14 01:15:42.869995 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 526/1059] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:42 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:15:43.893679 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-401d32fb-c6b9-4176-bfba-f8249ed374d5 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:43.894296 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-401d32fb-c6b9-4176-bfba-f8249ed374d5 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:43.900619 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-401d32fb-c6b9-4176-bfba-f8249ed374d5 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:43.901092 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-401d32fb-c6b9-4176-bfba-f8249ed374d5 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:43.901528 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-401d32fb-c6b9-4176-bfba-f8249ed374d5 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:43.902334 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-401d32fb-c6b9-4176-bfba-f8249ed374d5 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:43.902792 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-401d32fb-c6b9-4176-bfba-f8249ed374d5 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:43.903222 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-401d32fb-c6b9-4176-bfba-f8249ed374d5 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:44.046341 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-401d32fb-c6b9-4176-bfba-f8249ed374d5 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:44.055588 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-401d32fb-c6b9-4176-bfba-f8249ed374d5 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1756 microversion: 2.1 time: 0.165789 Sep 14 01:15:44.056188 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 534/1060] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:43 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:15:45.081278 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ab3454ae-2327-4db2-9a9e-0a8848662b31 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:45.081887 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ab3454ae-2327-4db2-9a9e-0a8848662b31 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:45.089932 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab3454ae-2327-4db2-9a9e-0a8848662b31 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:45.090430 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab3454ae-2327-4db2-9a9e-0a8848662b31 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:45.090904 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab3454ae-2327-4db2-9a9e-0a8848662b31 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:45.091902 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab3454ae-2327-4db2-9a9e-0a8848662b31 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:45.092382 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab3454ae-2327-4db2-9a9e-0a8848662b31 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:45.092805 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab3454ae-2327-4db2-9a9e-0a8848662b31 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:45.245535 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ab3454ae-2327-4db2-9a9e-0a8848662b31 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:45.254299 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ab3454ae-2327-4db2-9a9e-0a8848662b31 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1756 microversion: 2.1 time: 0.177021 Sep 14 01:15:45.254859 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 527/1061] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:45 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:15:46.281095 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8fa1f252-efb4-4968-9d69-d86a69fa22cd tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:46.281738 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8fa1f252-efb4-4968-9d69-d86a69fa22cd tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:46.288302 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8fa1f252-efb4-4968-9d69-d86a69fa22cd tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:46.288797 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8fa1f252-efb4-4968-9d69-d86a69fa22cd tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:46.289234 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8fa1f252-efb4-4968-9d69-d86a69fa22cd tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:46.289939 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8fa1f252-efb4-4968-9d69-d86a69fa22cd tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:46.290393 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8fa1f252-efb4-4968-9d69-d86a69fa22cd tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:46.290830 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8fa1f252-efb4-4968-9d69-d86a69fa22cd tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:46.687825 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8fa1f252-efb4-4968-9d69-d86a69fa22cd tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:46.696287 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8fa1f252-efb4-4968-9d69-d86a69fa22cd tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1756 microversion: 2.1 time: 0.419966 Sep 14 01:15:46.696800 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 535/1062] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:46 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1756 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:15:47.720971 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-cf83d5f4-69c5-4606-b8f5-cd8fdddaa250 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:47.726702 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-cf83d5f4-69c5-4606-b8f5-cd8fdddaa250 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:47.733792 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cf83d5f4-69c5-4606-b8f5-cd8fdddaa250 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:47.733975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cf83d5f4-69c5-4606-b8f5-cd8fdddaa250 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:47.734646 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cf83d5f4-69c5-4606-b8f5-cd8fdddaa250 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:47.735241 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cf83d5f4-69c5-4606-b8f5-cd8fdddaa250 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:47.735730 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cf83d5f4-69c5-4606-b8f5-cd8fdddaa250 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:47.736187 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cf83d5f4-69c5-4606-b8f5-cd8fdddaa250 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:47.888972 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cf83d5f4-69c5-4606-b8f5-cd8fdddaa250 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:15:47.899184 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-cf83d5f4-69c5-4606-b8f5-cd8fdddaa250 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1759 microversion: 2.1 time: 0.182229 Sep 14 01:15:47.899777 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 528/1063] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:15:47 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:15:51.116212 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-43809bba-cd91-45a1-b671-1bb32af5aae8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:15:51.116729 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-43809bba-cd91-45a1-b671-1bb32af5aae8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:51.123218 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-43809bba-cd91-45a1-b671-1bb32af5aae8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:51.123740 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-43809bba-cd91-45a1-b671-1bb32af5aae8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:51.124185 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-43809bba-cd91-45a1-b671-1bb32af5aae8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:51.124883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-43809bba-cd91-45a1-b671-1bb32af5aae8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:51.125341 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-43809bba-cd91-45a1-b671-1bb32af5aae8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:51.125769 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-43809bba-cd91-45a1-b671-1bb32af5aae8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:51.129377 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:15:51.151056 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-43809bba-cd91-45a1-b671-1bb32af5aae8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36/ips" status: 200 len: 151 microversion: 2.1 time: 0.228480 Sep 14 01:15:51.151625 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 536/1064] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Sep 14 01:15:50 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36/ips => generated 151 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:15:52.492082 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e40c992d-4056-4487-983a-dfa4e9017760 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60786ef5-468f-41be-b7aa-3bb71c61ca7d"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:15:52.494880 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e40c992d-4056-4487-983a-dfa4e9017760 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:15:52.497563 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:15:52.503078 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e40c992d-4056-4487-983a-dfa4e9017760 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:52.503588 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e40c992d-4056-4487-983a-dfa4e9017760 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:52.504017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e40c992d-4056-4487-983a-dfa4e9017760 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:52.504703 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e40c992d-4056-4487-983a-dfa4e9017760 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:15:52.505157 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e40c992d-4056-4487-983a-dfa4e9017760 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:15:52.505586 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e40c992d-4056-4487-983a-dfa4e9017760 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:15:52.769998 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e40c992d-4056-4487-983a-dfa4e9017760 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "POST /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281834 Sep 14 01:15:52.770703 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 529/1065] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 01:15:52 2022] POST /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:16:05.709099 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-81e022db-35ab-46fb-8c34-9a6cad116e57 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:05.709616 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-81e022db-35ab-46fb-8c34-9a6cad116e57 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:05.712081 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=7 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:16:05.717381 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-81e022db-35ab-46fb-8c34-9a6cad116e57 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:05.718510 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-81e022db-35ab-46fb-8c34-9a6cad116e57 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:05.719093 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-81e022db-35ab-46fb-8c34-9a6cad116e57 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:05.719825 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-81e022db-35ab-46fb-8c34-9a6cad116e57 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:05.720283 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-81e022db-35ab-46fb-8c34-9a6cad116e57 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:05.720710 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-81e022db-35ab-46fb-8c34-9a6cad116e57 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:05.800893 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-81e022db-35ab-46fb-8c34-9a6cad116e57 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lazy-loading 'services' on Instance uuid e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:16:05.876161 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-81e022db-35ab-46fb-8c34-9a6cad116e57 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36/os-volume_attachments/60786ef5-468f-41be-b7aa-3bb71c61ca7d" status: 202 len: 0 microversion: 2.1 time: 0.171017 Sep 14 01:16:05.876769 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 537/1066] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 01:16:05 2022] DELETE /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36/os-volume_attachments/60786ef5-468f-41be-b7aa-3bb71c61ca7d => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:16:05.887456 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-72455da2-0e16-404a-b870-d7d13d81ca37 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:05.890049 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-72455da2-0e16-404a-b870-d7d13d81ca37 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:05.892999 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:16:05.893727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:16:05.901080 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-72455da2-0e16-404a-b870-d7d13d81ca37 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:05.901566 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-72455da2-0e16-404a-b870-d7d13d81ca37 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:05.902000 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-72455da2-0e16-404a-b870-d7d13d81ca37 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:05.903067 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-72455da2-0e16-404a-b870-d7d13d81ca37 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:05.903522 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-72455da2-0e16-404a-b870-d7d13d81ca37 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:05.903972 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-72455da2-0e16-404a-b870-d7d13d81ca37 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:05.939911 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-72455da2-0e16-404a-b870-d7d13d81ca37 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057696 Sep 14 01:16:05.940467 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 530/1067] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 01:16:05 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:16:06.954066 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-f1b63fa9-9cf0-406c-a770-4b0f3e7aa511 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:06.956572 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-f1b63fa9-9cf0-406c-a770-4b0f3e7aa511 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:06.962747 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f1b63fa9-9cf0-406c-a770-4b0f3e7aa511 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:06.963231 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f1b63fa9-9cf0-406c-a770-4b0f3e7aa511 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:06.963707 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f1b63fa9-9cf0-406c-a770-4b0f3e7aa511 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:06.964431 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f1b63fa9-9cf0-406c-a770-4b0f3e7aa511 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:06.964849 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f1b63fa9-9cf0-406c-a770-4b0f3e7aa511 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:06.965272 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f1b63fa9-9cf0-406c-a770-4b0f3e7aa511 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:06.998331 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-f1b63fa9-9cf0-406c-a770-4b0f3e7aa511 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049202 Sep 14 01:16:06.998885 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 538/1068] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 01:16:06 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 01:16:07.068734 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c1514127-38be-4654-bf99-f97110503d31 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:07.069420 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c1514127-38be-4654-bf99-f97110503d31 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:07.076038 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c1514127-38be-4654-bf99-f97110503d31 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:07.076522 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c1514127-38be-4654-bf99-f97110503d31 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:07.076985 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c1514127-38be-4654-bf99-f97110503d31 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:07.077767 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c1514127-38be-4654-bf99-f97110503d31 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:07.078231 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c1514127-38be-4654-bf99-f97110503d31 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:07.078726 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c1514127-38be-4654-bf99-f97110503d31 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:07.104625 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c1514127-38be-4654-bf99-f97110503d31 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Going to try to terminate instance {{(pid=120621) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:16:07.178442 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c1514127-38be-4654-bf99-f97110503d31 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36" status: 204 len: 0 microversion: 2.1 time: 0.113431 Sep 14 01:16:07.179026 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 531/1069] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:16:07 2022] DELETE /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 01:16:07.187800 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6f5fce89-40b9-453a-b65e-43d1dd110b3d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:07.188415 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-6f5fce89-40b9-453a-b65e-43d1dd110b3d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:07.194310 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6f5fce89-40b9-453a-b65e-43d1dd110b3d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:07.194790 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6f5fce89-40b9-453a-b65e-43d1dd110b3d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:07.195224 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6f5fce89-40b9-453a-b65e-43d1dd110b3d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:07.195946 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6f5fce89-40b9-453a-b65e-43d1dd110b3d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:07.196404 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6f5fce89-40b9-453a-b65e-43d1dd110b3d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:07.196825 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6f5fce89-40b9-453a-b65e-43d1dd110b3d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:07.330896 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-6f5fce89-40b9-453a-b65e-43d1dd110b3d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:16:07.338616 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-6f5fce89-40b9-453a-b65e-43d1dd110b3d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36" status: 200 len: 1683 microversion: 2.1 time: 0.154944 Sep 14 01:16:07.339170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 539/1070] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:16:07 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:16:08.363571 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-85dc28cc-2b8a-4c45-955b-3b499b626132 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:08.364308 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-85dc28cc-2b8a-4c45-955b-3b499b626132 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:08.370657 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85dc28cc-2b8a-4c45-955b-3b499b626132 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:08.371144 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85dc28cc-2b8a-4c45-955b-3b499b626132 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:08.371605 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85dc28cc-2b8a-4c45-955b-3b499b626132 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:08.372305 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85dc28cc-2b8a-4c45-955b-3b499b626132 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:08.372762 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85dc28cc-2b8a-4c45-955b-3b499b626132 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:08.373189 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85dc28cc-2b8a-4c45-955b-3b499b626132 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:08.503715 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-85dc28cc-2b8a-4c45-955b-3b499b626132 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:16:08.511709 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-85dc28cc-2b8a-4c45-955b-3b499b626132 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36" status: 200 len: 1683 microversion: 2.1 time: 0.153041 Sep 14 01:16:08.512273 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 532/1071] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:16:08 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:16:09.535851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-77272ecb-581e-4722-91d6-3beaae7ea071 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:09.536469 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-77272ecb-581e-4722-91d6-3beaae7ea071 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:09.543049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-77272ecb-581e-4722-91d6-3beaae7ea071 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:09.543597 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-77272ecb-581e-4722-91d6-3beaae7ea071 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:09.544045 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-77272ecb-581e-4722-91d6-3beaae7ea071 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:09.544775 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-77272ecb-581e-4722-91d6-3beaae7ea071 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:09.545232 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-77272ecb-581e-4722-91d6-3beaae7ea071 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:09.545689 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-77272ecb-581e-4722-91d6-3beaae7ea071 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:09.680339 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-77272ecb-581e-4722-91d6-3beaae7ea071 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:16:09.688910 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-77272ecb-581e-4722-91d6-3beaae7ea071 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36" status: 200 len: 1683 microversion: 2.1 time: 0.157007 Sep 14 01:16:09.689480 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 540/1072] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:16:09 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:16:10.271883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-3ce42bc6-ca94-4519-bec5-62e87332ad32 req-a4298643-2c56-4af6-b23c-f57b0d3dc83d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8c88c9e-8c39-4b1a-9f75-5f49c8420a36", "name": "network-vif-deleted", "tag": "79795098-660f-4059-9056-a7702e992f63"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:16:10.280621 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-3ce42bc6-ca94-4519-bec5-62e87332ad32 req-a4298643-2c56-4af6-b23c-f57b0d3dc83d service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:10.281362 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-3ce42bc6-ca94-4519-bec5-62e87332ad32 req-a4298643-2c56-4af6-b23c-f57b0d3dc83d service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:10.281799 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-3ce42bc6-ca94-4519-bec5-62e87332ad32 req-a4298643-2c56-4af6-b23c-f57b0d3dc83d service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:10.300722 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-3ce42bc6-ca94-4519-bec5-62e87332ad32 req-a4298643-2c56-4af6-b23c-f57b0d3dc83d service nova] Creating event network-vif-deleted:79795098-660f-4059-9056-a7702e992f63 for instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 on hv-cinder-85752 Sep 14 01:16:10.306192 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-3ce42bc6-ca94-4519-bec5-62e87332ad32 req-a4298643-2c56-4af6-b23c-f57b0d3dc83d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044142 Sep 14 01:16:10.307164 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 533/1073] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:16:10.713427 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7b68c8a1-0b44-441a-9fd1-9166b188e6f8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:10.713427 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7b68c8a1-0b44-441a-9fd1-9166b188e6f8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:10.720044 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7b68c8a1-0b44-441a-9fd1-9166b188e6f8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:10.720607 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7b68c8a1-0b44-441a-9fd1-9166b188e6f8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:10.721114 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7b68c8a1-0b44-441a-9fd1-9166b188e6f8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:10.721866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7b68c8a1-0b44-441a-9fd1-9166b188e6f8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:10.722330 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7b68c8a1-0b44-441a-9fd1-9166b188e6f8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:10.722759 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7b68c8a1-0b44-441a-9fd1-9166b188e6f8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:10.758662 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7b68c8a1-0b44-441a-9fd1-9166b188e6f8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:10.759176 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7b68c8a1-0b44-441a-9fd1-9166b188e6f8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:10.759642 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7b68c8a1-0b44-441a-9fd1-9166b188e6f8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:10.760092 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-7b68c8a1-0b44-441a-9fd1-9166b188e6f8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lazy-loading 'fault' on Instance uuid e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:16:10.800479 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7b68c8a1-0b44-441a-9fd1-9166b188e6f8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51768890f19140b6819ef89f5bf610c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62cb41eb4b8244abb4aafd718b1207ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:16:10.809706 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7b68c8a1-0b44-441a-9fd1-9166b188e6f8 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36" status: 200 len: 1332 microversion: 2.1 time: 0.100906 Sep 14 01:16:10.810595 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 541/1074] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:16:10 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:16:11.836946 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3f35c4fc-7079-4056-8564-654a88f8a88c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:11.837663 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-3f35c4fc-7079-4056-8564-654a88f8a88c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:11.844441 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3f35c4fc-7079-4056-8564-654a88f8a88c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:11.844916 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3f35c4fc-7079-4056-8564-654a88f8a88c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:11.845350 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3f35c4fc-7079-4056-8564-654a88f8a88c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:11.846027 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3f35c4fc-7079-4056-8564-654a88f8a88c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:11.846478 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3f35c4fc-7079-4056-8564-654a88f8a88c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:11.846916 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-3f35c4fc-7079-4056-8564-654a88f8a88c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:11.859792 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-3f35c4fc-7079-4056-8564-654a88f8a88c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] HTTP exception thrown: Instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 could not be found. Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3f35c4fc-7079-4056-8564-654a88f8a88c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Request method failure captured: Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 HTTP/1.1 Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISi3fXiNfssV-9suzyOi_X569sc3LzFc1vlFMuwkYOTf31lKxNzFY-VkibuUEPaC7Cvi81CQQfr4-r5n6Uvso8OzNo7bKIe7TyRgCLDNh1PVRJBuibEZ3mG6c00LHLtCWy0Oxl5Ip8Qv9iueHnKypM6PjqQ0qUH7793Mq_rFlqjqMYA Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:16:11.861378 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:16:11.863030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:16:11.863030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:11.863030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:16:11.863030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:11.863030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:16:11.863030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:16:11.863030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:16:11.863030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: 51768890f19140b6819ef89f5bf610c8 Sep 14 01:16:11.863030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:16:11.863030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:16:11.863030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 could not be found. Sep 14 01:16:11.863030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': 'e8c88c9e-8c39-4b1a-9f75-5f49c8420a36'} Sep 14 01:16:11.864125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:16:11.864125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:11.864125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:16:11.864125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:16:11.864125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:16:11.864125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:16:11.864125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:16:11.864125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:16:11.864125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:16:11.864125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:16:11.864125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 could not be found. Sep 14 01:16:11.864125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:11.864125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:11.864125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:11.864125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:11.864125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:11.864125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:11.864125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:16:11.864125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:16:11.864125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:16:11.865397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:16:11.865397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:16:11.865397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:16:11.865397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:16:11.865397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:16:11.865397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:16:11.865397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:16:11.865397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 could not be found. Sep 14 01:16:11.865397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:11.865397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:11.865397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:11.865397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:11.865397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:11.865397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:11.865397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:16:11.865397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:16:11.865397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 could not be found. Sep 14 01:16:11.865397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:11.866661 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-3f35c4fc-7079-4056-8564-654a88f8a88c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Returning 404 to user: Instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:16:11.866661 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-3f35c4fc-7079-4056-8564-654a88f8a88c tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36" status: 404 len: 111 microversion: 2.1 time: 0.030517 Sep 14 01:16:11.866661 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 534/1075] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:16:11 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:16:11.871600 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-53ab4d7b-1f5a-490b-a9aa-19d9793d90ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '.version_select at 0x7f5048096af0>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:11.891466 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-53ab4d7b-1f5a-490b-a9aa-19d9793d90ab tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274343025" status: 202 len: 0 microversion: 2.1 time: 0.023585 Sep 14 01:16:11.891996 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 542/1076] 10.222.0.42 () {58 vars in 1221 bytes} [Wed Sep 14 01:16:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274343025 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:16:15.932940 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a48dfa7b-bedc-44ed-b170-096cfbf7c589 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:15.935059 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a48dfa7b-bedc-44ed-b170-096cfbf7c589 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:15.941780 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a48dfa7b-bedc-44ed-b170-096cfbf7c589 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:15.942251 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a48dfa7b-bedc-44ed-b170-096cfbf7c589 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:15.942682 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a48dfa7b-bedc-44ed-b170-096cfbf7c589 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:15.943355 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a48dfa7b-bedc-44ed-b170-096cfbf7c589 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:15.943828 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a48dfa7b-bedc-44ed-b170-096cfbf7c589 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:15.944246 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a48dfa7b-bedc-44ed-b170-096cfbf7c589 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:15.974301 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a48dfa7b-bedc-44ed-b170-096cfbf7c589 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045237 Sep 14 01:16:15.974771 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 535/1077] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Sep 14 01:16:15 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:16:16.037808 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-446267e2-528b-4a24-8f7a-890ebe99cf04 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:16.038308 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-446267e2-528b-4a24-8f7a-890ebe99cf04 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:16.044718 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-446267e2-528b-4a24-8f7a-890ebe99cf04 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:16.045207 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-446267e2-528b-4a24-8f7a-890ebe99cf04 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:16.045647 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-446267e2-528b-4a24-8f7a-890ebe99cf04 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:16.046372 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-446267e2-528b-4a24-8f7a-890ebe99cf04 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:16.046809 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-446267e2-528b-4a24-8f7a-890ebe99cf04 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:16.047235 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-446267e2-528b-4a24-8f7a-890ebe99cf04 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:16.070941 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-446267e2-528b-4a24-8f7a-890ebe99cf04 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Going to try to terminate instance {{(pid=120620) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:16:16.146768 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-446267e2-528b-4a24-8f7a-890ebe99cf04 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "DELETE /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 204 len: 0 microversion: 2.20 time: 0.112967 Sep 14 01:16:16.147918 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 543/1078] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Sep 14 01:16:16 2022] DELETE /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 01:16:16.158166 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9e9f8577-30e1-4c09-94b9-bd0d3bf1903f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:16.158797 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9e9f8577-30e1-4c09-94b9-bd0d3bf1903f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:16.164774 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9e9f8577-30e1-4c09-94b9-bd0d3bf1903f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:16.165247 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9e9f8577-30e1-4c09-94b9-bd0d3bf1903f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:16.165873 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9e9f8577-30e1-4c09-94b9-bd0d3bf1903f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:16.166761 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9e9f8577-30e1-4c09-94b9-bd0d3bf1903f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:16.167213 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9e9f8577-30e1-4c09-94b9-bd0d3bf1903f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:16.167675 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9e9f8577-30e1-4c09-94b9-bd0d3bf1903f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:16.299623 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9e9f8577-30e1-4c09-94b9-bd0d3bf1903f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:16:16.307679 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9e9f8577-30e1-4c09-94b9-bd0d3bf1903f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:16:16.309189 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9e9f8577-30e1-4c09-94b9-bd0d3bf1903f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:16:16.310390 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9e9f8577-30e1-4c09-94b9-bd0d3bf1903f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.156999 Sep 14 01:16:16.310950 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 536/1079] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:16:16 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:16:16.800450 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-74f42ab8-99d4-4bd2-92a1-90b01bb8da43 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:16.801214 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-74f42ab8-99d4-4bd2-92a1-90b01bb8da43 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:16.807275 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-74f42ab8-99d4-4bd2-92a1-90b01bb8da43 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:16.807804 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-74f42ab8-99d4-4bd2-92a1-90b01bb8da43 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:16.808295 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-74f42ab8-99d4-4bd2-92a1-90b01bb8da43 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:16.808990 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-74f42ab8-99d4-4bd2-92a1-90b01bb8da43 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:16.809453 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-74f42ab8-99d4-4bd2-92a1-90b01bb8da43 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:16.809875 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-74f42ab8-99d4-4bd2-92a1-90b01bb8da43 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:16.823678 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-74f42ab8-99d4-4bd2-92a1-90b01bb8da43 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] HTTP exception thrown: Instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 could not be found. Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-74f42ab8-99d4-4bd2-92a1-90b01bb8da43 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Request method failure captured: Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: DELETE /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 HTTP/1.1 Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISi3fXiNfssV-9suzyOi_X569sc3LzFc1vlFMuwkYOTf31lKxNzFY-VkibuUEPaC7Cvi81CQQfr4-r5n6Uvso8OzNo7bKIe7TyRgCLDNh1PVRJBuibEZ3mG6c00LHLtCWy0Oxl5Ip8Qv9iueHnKypM6PjqQ0qUH7793Mq_rFlqjqMYA Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:16:16.825379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:16:16.826837 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:16:16.826837 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:16.826837 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:16:16.826837 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:16.826837 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:16:16.826837 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:16:16.826837 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:16:16.826837 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: 51768890f19140b6819ef89f5bf610c8 Sep 14 01:16:16.826837 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:16:16.826837 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:16:16.826837 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 could not be found. Sep 14 01:16:16.826837 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': 'e8c88c9e-8c39-4b1a-9f75-5f49c8420a36'} Sep 14 01:16:16.827654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:16:16.827654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:16.827654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:16:16.827654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:16:16.827654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:16:16.827654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:16:16.827654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:16:16.827654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:16:16.827654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:16:16.827654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:16:16.827654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 could not be found. Sep 14 01:16:16.827654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:16.827654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:16.827654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:16.827654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:16.827654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:16.827654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:16.827654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:16:16.827654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:16:16.827654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:16:16.829385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:16:16.829385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 01:16:16.829385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 01:16:16.829385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 01:16:16.829385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 01:16:16.829385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:16:16.829385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:16:16.829385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:16:16.829385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:16:16.829385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 could not be found. Sep 14 01:16:16.829385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:16.829385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:16.829385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:16.829385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:16.829385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:16.829385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:16.829385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:16:16.829385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:16:16.829385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 could not be found. Sep 14 01:16:16.829385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:16.832235 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-74f42ab8-99d4-4bd2-92a1-90b01bb8da43 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Returning 404 to user: Instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:16:16.832235 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-74f42ab8-99d4-4bd2-92a1-90b01bb8da43 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36" status: 404 len: 111 microversion: 2.1 time: 0.031730 Sep 14 01:16:16.832235 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 544/1080] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:16:16 2022] DELETE /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:16:16.835428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-85443062-952e-421a-b71d-2bc7e9e25fd3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:16.836060 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-85443062-952e-421a-b71d-2bc7e9e25fd3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: e8c88c9e-8c39-4b1a-9f75-5f49c8420a36] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:16.841987 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85443062-952e-421a-b71d-2bc7e9e25fd3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:16.842469 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85443062-952e-421a-b71d-2bc7e9e25fd3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:16.843786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85443062-952e-421a-b71d-2bc7e9e25fd3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:16.844518 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85443062-952e-421a-b71d-2bc7e9e25fd3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:16.844989 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85443062-952e-421a-b71d-2bc7e9e25fd3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:16.845365 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-85443062-952e-421a-b71d-2bc7e9e25fd3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:16.859721 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-85443062-952e-421a-b71d-2bc7e9e25fd3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] HTTP exception thrown: Instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 could not be found. Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-85443062-952e-421a-b71d-2bc7e9e25fd3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Request method failure captured: Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 HTTP/1.1 Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISi3fXiNfssV-9suzyOi_X569sc3LzFc1vlFMuwkYOTf31lKxNzFY-VkibuUEPaC7Cvi81CQQfr4-r5n6Uvso8OzNo7bKIe7TyRgCLDNh1PVRJBuibEZ3mG6c00LHLtCWy0Oxl5Ip8Qv9iueHnKypM6PjqQ0qUH7793Mq_rFlqjqMYA Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:16:16.861412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:16:16.862725 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:16:16.862725 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:16.862725 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:16:16.862725 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:16.862725 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:16:16.862725 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:16:16.862725 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:16:16.862725 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: 51768890f19140b6819ef89f5bf610c8 Sep 14 01:16:16.862725 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:16:16.862725 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:16:16.862725 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 could not be found. Sep 14 01:16:16.862725 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': 'e8c88c9e-8c39-4b1a-9f75-5f49c8420a36'} Sep 14 01:16:16.863619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:16:16.863619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:16.863619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:16:16.863619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:16:16.863619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:16:16.863619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:16:16.863619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:16:16.863619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:16:16.863619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:16:16.863619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:16:16.863619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 could not be found. Sep 14 01:16:16.863619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:16.863619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:16.863619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:16.863619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:16.863619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:16.863619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:16.863619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:16:16.863619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:16:16.863619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:16:16.864975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:16:16.864975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:16:16.864975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:16:16.864975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:16:16.864975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:16:16.864975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:16:16.864975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:16:16.864975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 could not be found. Sep 14 01:16:16.864975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:16.864975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:16.864975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:16.864975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:16.864975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:16.864975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:16.864975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:16:16.864975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:16:16.864975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 could not be found. Sep 14 01:16:16.864975 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:16.866271 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-85443062-952e-421a-b71d-2bc7e9e25fd3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Returning 404 to user: Instance e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:16:16.866271 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-85443062-952e-421a-b71d-2bc7e9e25fd3 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36" status: 404 len: 111 microversion: 2.1 time: 0.031178 Sep 14 01:16:16.866601 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 537/1081] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:16:16 2022] GET /compute/v2.1/servers/e8c88c9e-8c39-4b1a-9f75-5f49c8420a36 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:16:17.336159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8d121ff4-2554-4777-af6c-ef3cdf5a62f7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:17.336703 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8d121ff4-2554-4777-af6c-ef3cdf5a62f7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:17.343780 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d121ff4-2554-4777-af6c-ef3cdf5a62f7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:17.344380 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d121ff4-2554-4777-af6c-ef3cdf5a62f7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:17.344932 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d121ff4-2554-4777-af6c-ef3cdf5a62f7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:17.346011 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d121ff4-2554-4777-af6c-ef3cdf5a62f7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:17.346854 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d121ff4-2554-4777-af6c-ef3cdf5a62f7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:17.347318 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d121ff4-2554-4777-af6c-ef3cdf5a62f7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:17.489144 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8d121ff4-2554-4777-af6c-ef3cdf5a62f7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:16:17.497169 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8d121ff4-2554-4777-af6c-ef3cdf5a62f7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:16:17.498603 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8d121ff4-2554-4777-af6c-ef3cdf5a62f7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:16:17.501079 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8d121ff4-2554-4777-af6c-ef3cdf5a62f7 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.168112 Sep 14 01:16:17.501875 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 545/1082] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:16:17 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:16:18.015713 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ef0f5696-afc3-42e4-b657-8280e06b6355 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:18.016211 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ef0f5696-afc3-42e4-b657-8280e06b6355 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:18.022635 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ef0f5696-afc3-42e4-b657-8280e06b6355 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:18.023120 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ef0f5696-afc3-42e4-b657-8280e06b6355 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:18.023570 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ef0f5696-afc3-42e4-b657-8280e06b6355 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:18.024271 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ef0f5696-afc3-42e4-b657-8280e06b6355 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:18.024728 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ef0f5696-afc3-42e4-b657-8280e06b6355 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:18.025157 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ef0f5696-afc3-42e4-b657-8280e06b6355 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:18.038314 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-ef0f5696-afc3-42e4-b657-8280e06b6355 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] HTTP exception thrown: Instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 could not be found. Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ef0f5696-afc3-42e4-b657-8280e06b6355 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Request method failure captured: Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: DELETE /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 HTTP/1.1 Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISi3fXiNfssV-9suzyOi_X569sc3LzFc1vlFMuwkYOTf31lKxNzFY-VkibuUEPaC7Cvi81CQQfr4-r5n6Uvso8OzNo7bKIe7TyRgCLDNh1PVRJBuibEZ3mG6c00LHLtCWy0Oxl5Ip8Qv9iueHnKypM6PjqQ0qUH7793Mq_rFlqjqMYA Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:16:18.039884 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:16:18.041491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:16:18.041491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:18.041491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:16:18.041491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:18.041491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:16:18.041491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:16:18.041491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:16:18.041491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: 51768890f19140b6819ef89f5bf610c8 Sep 14 01:16:18.041491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:16:18.041491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:16:18.041491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 could not be found. Sep 14 01:16:18.041491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': '49f5ab2e-e424-49af-81ac-dc4b94c742b9'} Sep 14 01:16:18.042397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:16:18.042397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:18.042397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:16:18.042397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:16:18.042397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:16:18.042397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:16:18.042397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:16:18.042397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:16:18.042397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:16:18.042397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:16:18.042397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 could not be found. Sep 14 01:16:18.042397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:18.042397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:18.042397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:18.042397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:18.042397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:18.042397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:18.042397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:16:18.042397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:16:18.042397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:16:18.043925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:16:18.043925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 01:16:18.043925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 01:16:18.043925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 01:16:18.043925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 01:16:18.043925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:16:18.043925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:16:18.043925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:16:18.043925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:16:18.043925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 could not be found. Sep 14 01:16:18.043925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:18.043925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:18.043925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:18.043925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:18.043925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:18.043925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:18.043925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:16:18.043925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:16:18.043925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 could not be found. Sep 14 01:16:18.043925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:18.045476 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ef0f5696-afc3-42e4-b657-8280e06b6355 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Returning 404 to user: Instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:16:18.045476 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ef0f5696-afc3-42e4-b657-8280e06b6355 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "DELETE /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 404 len: 111 microversion: 2.1 time: 0.029545 Sep 14 01:16:18.045476 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 538/1083] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:16:18 2022] DELETE /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:16:18.050547 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-04e71bb6-d75a-43d5-82b8-9661c9b5a3f4 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:18.051165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-04e71bb6-d75a-43d5-82b8-9661c9b5a3f4 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 49f5ab2e-e424-49af-81ac-dc4b94c742b9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:18.057476 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-04e71bb6-d75a-43d5-82b8-9661c9b5a3f4 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:18.057955 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-04e71bb6-d75a-43d5-82b8-9661c9b5a3f4 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:18.058389 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-04e71bb6-d75a-43d5-82b8-9661c9b5a3f4 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:18.059067 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-04e71bb6-d75a-43d5-82b8-9661c9b5a3f4 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:18.059522 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-04e71bb6-d75a-43d5-82b8-9661c9b5a3f4 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:18.059971 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-04e71bb6-d75a-43d5-82b8-9661c9b5a3f4 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:18.074292 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-04e71bb6-d75a-43d5-82b8-9661c9b5a3f4 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] HTTP exception thrown: Instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 could not be found. Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-04e71bb6-d75a-43d5-82b8-9661c9b5a3f4 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Request method failure captured: Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 HTTP/1.1 Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISi3fXiNfssV-9suzyOi_X569sc3LzFc1vlFMuwkYOTf31lKxNzFY-VkibuUEPaC7Cvi81CQQfr4-r5n6Uvso8OzNo7bKIe7TyRgCLDNh1PVRJBuibEZ3mG6c00LHLtCWy0Oxl5Ip8Qv9iueHnKypM6PjqQ0qUH7793Mq_rFlqjqMYA Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:16:18.075851 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:16:18.077492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:16:18.077492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:18.077492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:16:18.077492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:18.077492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:16:18.077492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:16:18.077492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:16:18.077492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: 51768890f19140b6819ef89f5bf610c8 Sep 14 01:16:18.077492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:16:18.077492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:16:18.077492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 could not be found. Sep 14 01:16:18.077492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': '49f5ab2e-e424-49af-81ac-dc4b94c742b9'} Sep 14 01:16:18.078422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:16:18.078422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:18.078422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:16:18.078422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:16:18.078422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:16:18.078422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:16:18.078422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:16:18.078422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:16:18.078422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:16:18.078422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:16:18.078422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 could not be found. Sep 14 01:16:18.078422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:18.078422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:18.078422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:18.078422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:18.078422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:18.078422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:18.078422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:16:18.078422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:16:18.078422 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:16:18.080053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:16:18.080053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:16:18.080053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:16:18.080053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:16:18.080053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:16:18.080053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:16:18.080053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:16:18.080053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 could not be found. Sep 14 01:16:18.080053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:18.080053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:18.080053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:18.080053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:18.080053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:18.080053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:18.080053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:16:18.080053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:16:18.080053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 could not be found. Sep 14 01:16:18.080053 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:18.081498 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-04e71bb6-d75a-43d5-82b8-9661c9b5a3f4 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Returning 404 to user: Instance 49f5ab2e-e424-49af-81ac-dc4b94c742b9 could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:16:18.081498 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-04e71bb6-d75a-43d5-82b8-9661c9b5a3f4 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9" status: 404 len: 111 microversion: 2.1 time: 0.031219 Sep 14 01:16:18.081498 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 546/1084] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:16:18 2022] GET /compute/v2.1/servers/49f5ab2e-e424-49af-81ac-dc4b94c742b9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:16:18.086132 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-355fb799-7ed9-4d60-b90b-fbae3adab06d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:18.086628 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-355fb799-7ed9-4d60-b90b-fbae3adab06d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:18.092555 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-355fb799-7ed9-4d60-b90b-fbae3adab06d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:18.093839 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-355fb799-7ed9-4d60-b90b-fbae3adab06d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:18.094487 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-355fb799-7ed9-4d60-b90b-fbae3adab06d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:18.095184 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-355fb799-7ed9-4d60-b90b-fbae3adab06d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:18.095669 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-355fb799-7ed9-4d60-b90b-fbae3adab06d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:18.096095 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-355fb799-7ed9-4d60-b90b-fbae3adab06d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:18.110469 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-355fb799-7ed9-4d60-b90b-fbae3adab06d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] HTTP exception thrown: Instance 09c7d241-afe4-4cee-a009-fa481d6abe5e could not be found. Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-355fb799-7ed9-4d60-b90b-fbae3adab06d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Request method failure captured: Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: DELETE /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e HTTP/1.1 Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISi3fXiNfssV-9suzyOi_X569sc3LzFc1vlFMuwkYOTf31lKxNzFY-VkibuUEPaC7Cvi81CQQfr4-r5n6Uvso8OzNo7bKIe7TyRgCLDNh1PVRJBuibEZ3mG6c00LHLtCWy0Oxl5Ip8Qv9iueHnKypM6PjqQ0qUH7793Mq_rFlqjqMYA Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:16:18.112040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:16:18.114012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:16:18.114012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:18.114012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:16:18.114012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:18.114012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:16:18.114012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:16:18.114012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:16:18.114012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: 51768890f19140b6819ef89f5bf610c8 Sep 14 01:16:18.114012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:16:18.114012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:16:18.114012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Instance 09c7d241-afe4-4cee-a009-fa481d6abe5e could not be found. Sep 14 01:16:18.114012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': '09c7d241-afe4-4cee-a009-fa481d6abe5e'} Sep 14 01:16:18.115159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:16:18.115159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:18.115159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:16:18.115159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:16:18.115159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:16:18.115159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:16:18.115159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:16:18.115159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:16:18.115159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:16:18.115159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:16:18.115159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09c7d241-afe4-4cee-a009-fa481d6abe5e could not be found. Sep 14 01:16:18.115159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:18.115159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:18.115159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:18.115159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:18.115159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:18.115159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:18.115159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:16:18.115159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:16:18.115159 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:16:18.116708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:16:18.116708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 01:16:18.116708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 01:16:18.116708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 01:16:18.116708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 01:16:18.116708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:16:18.116708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:16:18.116708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:16:18.116708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:16:18.116708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09c7d241-afe4-4cee-a009-fa481d6abe5e could not be found. Sep 14 01:16:18.116708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:18.116708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:18.116708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:18.116708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:18.116708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:18.116708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:18.116708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:16:18.116708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:16:18.116708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09c7d241-afe4-4cee-a009-fa481d6abe5e could not be found. Sep 14 01:16:18.116708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:18.118439 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-355fb799-7ed9-4d60-b90b-fbae3adab06d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Returning 404 to user: Instance 09c7d241-afe4-4cee-a009-fa481d6abe5e could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:16:18.118439 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-355fb799-7ed9-4d60-b90b-fbae3adab06d tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "DELETE /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 404 len: 111 microversion: 2.1 time: 0.031406 Sep 14 01:16:18.118439 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 539/1085] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:16:18 2022] DELETE /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 01:16:18.122094 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a1b0b98b-1db1-4222-be2a-8939279799fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:18.122702 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a1b0b98b-1db1-4222-be2a-8939279799fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: 09c7d241-afe4-4cee-a009-fa481d6abe5e] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:18.129217 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a1b0b98b-1db1-4222-be2a-8939279799fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:18.129709 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a1b0b98b-1db1-4222-be2a-8939279799fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:18.130145 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a1b0b98b-1db1-4222-be2a-8939279799fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:18.131669 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a1b0b98b-1db1-4222-be2a-8939279799fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:18.132130 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a1b0b98b-1db1-4222-be2a-8939279799fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:18.132560 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a1b0b98b-1db1-4222-be2a-8939279799fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:18.149919 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-a1b0b98b-1db1-4222-be2a-8939279799fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] HTTP exception thrown: Instance 09c7d241-afe4-4cee-a009-fa481d6abe5e could not be found. Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a1b0b98b-1db1-4222-be2a-8939279799fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Request method failure captured: Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e HTTP/1.1 Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISi3fXiNfssV-9suzyOi_X569sc3LzFc1vlFMuwkYOTf31lKxNzFY-VkibuUEPaC7Cvi81CQQfr4-r5n6Uvso8OzNo7bKIe7TyRgCLDNh1PVRJBuibEZ3mG6c00LHLtCWy0Oxl5Ip8Qv9iueHnKypM6PjqQ0qUH7793Mq_rFlqjqMYA Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:16:18.151447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:16:18.152965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:16:18.152965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:18.152965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:16:18.152965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:18.152965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:16:18.152965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:16:18.152965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:16:18.152965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: 51768890f19140b6819ef89f5bf610c8 Sep 14 01:16:18.152965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:16:18.152965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:16:18.152965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance 09c7d241-afe4-4cee-a009-fa481d6abe5e could not be found. Sep 14 01:16:18.152965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': '09c7d241-afe4-4cee-a009-fa481d6abe5e'} Sep 14 01:16:18.153763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:16:18.153763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:18.153763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:16:18.153763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:16:18.153763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:16:18.153763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:16:18.153763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:16:18.153763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:16:18.153763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:16:18.153763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:16:18.153763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09c7d241-afe4-4cee-a009-fa481d6abe5e could not be found. Sep 14 01:16:18.153763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:18.153763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:18.153763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:18.153763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:18.153763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:18.153763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:18.153763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:16:18.153763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:16:18.153763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:16:18.155013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:16:18.155013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:16:18.155013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:16:18.155013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:16:18.155013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:16:18.155013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:16:18.155013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:16:18.155013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09c7d241-afe4-4cee-a009-fa481d6abe5e could not be found. Sep 14 01:16:18.155013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:18.155013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:18.155013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:18.155013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:18.155013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:18.155013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:18.155013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:16:18.155013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:16:18.155013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09c7d241-afe4-4cee-a009-fa481d6abe5e could not be found. Sep 14 01:16:18.155013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:18.158366 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a1b0b98b-1db1-4222-be2a-8939279799fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Returning 404 to user: Instance 09c7d241-afe4-4cee-a009-fa481d6abe5e could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:16:18.158366 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a1b0b98b-1db1-4222-be2a-8939279799fc tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e" status: 404 len: 111 microversion: 2.1 time: 0.034528 Sep 14 01:16:18.158366 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 547/1086] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:16:18 2022] GET /compute/v2.1/servers/09c7d241-afe4-4cee-a009-fa481d6abe5e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:16:18.528724 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-480b42ad-859e-484b-9251-cf739b26ec92 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:18.529352 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-480b42ad-859e-484b-9251-cf739b26ec92 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:18.536390 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-480b42ad-859e-484b-9251-cf739b26ec92 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:18.536878 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-480b42ad-859e-484b-9251-cf739b26ec92 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:18.537322 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-480b42ad-859e-484b-9251-cf739b26ec92 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:18.538039 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-480b42ad-859e-484b-9251-cf739b26ec92 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:18.538493 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-480b42ad-859e-484b-9251-cf739b26ec92 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:18.538923 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-480b42ad-859e-484b-9251-cf739b26ec92 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:18.754589 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-480b42ad-859e-484b-9251-cf739b26ec92 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:16:18.766787 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-480b42ad-859e-484b-9251-cf739b26ec92 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:16:18.768391 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-480b42ad-859e-484b-9251-cf739b26ec92 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e4ad2d06f62246be8eb162257cbb4f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6482bb91c24939ba18c03a3e5bb18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:16:18.769550 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-480b42ad-859e-484b-9251-cf739b26ec92 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 200 len: 1725 microversion: 2.20 time: 0.245034 Sep 14 01:16:18.770239 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 540/1087] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:16:18 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 01:16:19.030293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-9837e40d-e606-43b9-872a-a794aafff163 req-57dba498-2060-44b0-abf5-219d1e8585a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291f27aa-9e42-4937-be7d-5e849d90e611", "name": "network-vif-deleted", "tag": "5a0c8ef2-8392-47a2-bf1c-1530912083d1"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:16:19.041519 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-9837e40d-e606-43b9-872a-a794aafff163 req-57dba498-2060-44b0-abf5-219d1e8585a0 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:19.041989 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-9837e40d-e606-43b9-872a-a794aafff163 req-57dba498-2060-44b0-abf5-219d1e8585a0 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:19.042420 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-9837e40d-e606-43b9-872a-a794aafff163 req-57dba498-2060-44b0-abf5-219d1e8585a0 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:19.060832 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-9837e40d-e606-43b9-872a-a794aafff163 req-57dba498-2060-44b0-abf5-219d1e8585a0 service nova] Creating event network-vif-deleted:5a0c8ef2-8392-47a2-bf1c-1530912083d1 for instance 291f27aa-9e42-4937-be7d-5e849d90e611 on hv-cinder-85752 Sep 14 01:16:19.066731 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-9837e40d-e606-43b9-872a-a794aafff163 req-57dba498-2060-44b0-abf5-219d1e8585a0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040207 Sep 14 01:16:19.067701 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 548/1088] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:16:19.310097 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4d1e264d-9a36-4743-9cc9-7ac8a91f9de6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:19.310604 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4d1e264d-9a36-4743-9cc9-7ac8a91f9de6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:19.317697 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d1e264d-9a36-4743-9cc9-7ac8a91f9de6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:19.318179 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d1e264d-9a36-4743-9cc9-7ac8a91f9de6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:19.318613 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d1e264d-9a36-4743-9cc9-7ac8a91f9de6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:19.319297 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d1e264d-9a36-4743-9cc9-7ac8a91f9de6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:19.319772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d1e264d-9a36-4743-9cc9-7ac8a91f9de6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:19.320197 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4d1e264d-9a36-4743-9cc9-7ac8a91f9de6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:19.333844 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-4d1e264d-9a36-4743-9cc9-7ac8a91f9de6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] HTTP exception thrown: Instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a could not be found. Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4d1e264d-9a36-4743-9cc9-7ac8a91f9de6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Request method failure captured: Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: DELETE /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a HTTP/1.1 Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISi3fXiNfssV-9suzyOi_X569sc3LzFc1vlFMuwkYOTf31lKxNzFY-VkibuUEPaC7Cvi81CQQfr4-r5n6Uvso8OzNo7bKIe7TyRgCLDNh1PVRJBuibEZ3mG6c00LHLtCWy0Oxl5Ip8Qv9iueHnKypM6PjqQ0qUH7793Mq_rFlqjqMYA Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:16:19.335402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:16:19.337025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:16:19.337025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:19.337025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:16:19.337025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:19.337025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:16:19.337025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:16:19.337025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:16:19.337025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: 51768890f19140b6819ef89f5bf610c8 Sep 14 01:16:19.337025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:16:19.337025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:16:19.337025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a could not be found. Sep 14 01:16:19.337025 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': 'f390b4d1-983e-4ea4-bb3f-e7e7e82a564a'} Sep 14 01:16:19.337778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:16:19.337778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:19.337778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:16:19.337778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:16:19.337778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:16:19.337778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:16:19.337778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:16:19.337778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:16:19.337778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:16:19.337778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:16:19.337778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a could not be found. Sep 14 01:16:19.337778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:19.337778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:19.337778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:19.337778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:19.337778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:19.337778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:19.337778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:16:19.337778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:16:19.337778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:16:19.339017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:16:19.339017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 01:16:19.339017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 01:16:19.339017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 01:16:19.339017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 01:16:19.339017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:16:19.339017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:16:19.339017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:16:19.339017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:16:19.339017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a could not be found. Sep 14 01:16:19.339017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:19.339017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:19.339017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:19.339017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:19.339017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:19.339017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:19.339017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:16:19.339017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:16:19.339017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a could not be found. Sep 14 01:16:19.339017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:19.340334 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4d1e264d-9a36-4743-9cc9-7ac8a91f9de6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Returning 404 to user: Instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:16:19.340334 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4d1e264d-9a36-4743-9cc9-7ac8a91f9de6 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 404 len: 111 microversion: 2.1 time: 0.030553 Sep 14 01:16:19.340334 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 541/1089] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:16:19 2022] DELETE /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:16:19.345801 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-1522d459-fef2-4a9a-bd1a-b2386f967451 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:19.346503 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-1522d459-fef2-4a9a-bd1a-b2386f967451 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] [instance: f390b4d1-983e-4ea4-bb3f-e7e7e82a564a] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:19.352619 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1522d459-fef2-4a9a-bd1a-b2386f967451 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:19.353104 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1522d459-fef2-4a9a-bd1a-b2386f967451 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:19.353541 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1522d459-fef2-4a9a-bd1a-b2386f967451 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:19.354233 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1522d459-fef2-4a9a-bd1a-b2386f967451 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:19.354696 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1522d459-fef2-4a9a-bd1a-b2386f967451 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:19.355146 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1522d459-fef2-4a9a-bd1a-b2386f967451 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:19.368955 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-1522d459-fef2-4a9a-bd1a-b2386f967451 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] HTTP exception thrown: Instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a could not be found. Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-1522d459-fef2-4a9a-bd1a-b2386f967451 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Request method failure captured: Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a HTTP/1.1 Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISi3fXiNfssV-9suzyOi_X569sc3LzFc1vlFMuwkYOTf31lKxNzFY-VkibuUEPaC7Cvi81CQQfr4-r5n6Uvso8OzNo7bKIe7TyRgCLDNh1PVRJBuibEZ3mG6c00LHLtCWy0Oxl5Ip8Qv9iueHnKypM6PjqQ0qUH7793Mq_rFlqjqMYA Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:16:19.370576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:16:19.372159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62cb41eb4b8244abb4aafd718b1207ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:16:19.372159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:19.372159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 62cb41eb4b8244abb4aafd718b1207ad Sep 14 01:16:19.372159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-622415410 Sep 14 01:16:19.372159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:16:19.372159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:16:19.372159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:16:19.372159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: 51768890f19140b6819ef89f5bf610c8 Sep 14 01:16:19.372159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-AttachVolumeNegativeTest-622415410-project Sep 14 01:16:19.372159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:16:19.372159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a could not be found. Sep 14 01:16:19.372159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': 'f390b4d1-983e-4ea4-bb3f-e7e7e82a564a'} Sep 14 01:16:19.373108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:16:19.373108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:19.373108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:16:19.373108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:16:19.373108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:16:19.373108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:16:19.373108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:16:19.373108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:16:19.373108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:16:19.373108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:16:19.373108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a could not be found. Sep 14 01:16:19.373108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:19.373108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:19.373108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:19.373108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:19.373108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:19.373108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:19.373108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:16:19.373108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:16:19.373108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:16:19.375421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:16:19.375421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:16:19.375421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:16:19.375421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:16:19.375421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:16:19.375421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:16:19.375421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:16:19.375421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a could not be found. Sep 14 01:16:19.375421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:19.375421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:19.375421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:19.375421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:19.375421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:19.375421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:19.375421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:16:19.375421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:16:19.375421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a could not be found. Sep 14 01:16:19.375421 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:19.376717 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-1522d459-fef2-4a9a-bd1a-b2386f967451 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] Returning 404 to user: Instance f390b4d1-983e-4ea4-bb3f-e7e7e82a564a could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:16:19.376717 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-1522d459-fef2-4a9a-bd1a-b2386f967451 tempest-AttachVolumeNegativeTest-622415410 tempest-AttachVolumeNegativeTest-622415410-project] 10.222.0.42 "GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a" status: 404 len: 111 microversion: 2.1 time: 0.030416 Sep 14 01:16:19.376717 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 549/1090] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:16:19 2022] GET /compute/v2.1/servers/f390b4d1-983e-4ea4-bb3f-e7e7e82a564a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:16:19.799787 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4fd8a5d4-4776-4bc8-884e-b019357d8d3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:19.802646 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4fd8a5d4-4776-4bc8-884e-b019357d8d3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:19.812500 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4fd8a5d4-4776-4bc8-884e-b019357d8d3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:19.813321 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4fd8a5d4-4776-4bc8-884e-b019357d8d3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:19.814068 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4fd8a5d4-4776-4bc8-884e-b019357d8d3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:19.815502 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4fd8a5d4-4776-4bc8-884e-b019357d8d3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:19.816291 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4fd8a5d4-4776-4bc8-884e-b019357d8d3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:19.816862 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4fd8a5d4-4776-4bc8-884e-b019357d8d3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:19.854185 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-4fd8a5d4-4776-4bc8-884e-b019357d8d3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] HTTP exception thrown: Instance 291f27aa-9e42-4937-be7d-5e849d90e611 could not be found. Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4fd8a5d4-4776-4bc8-884e-b019357d8d3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Request method failure captured: Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 HTTP/1.1 Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISi5NAtlwNVAUPorDKGIaO0iprs9LJQxC18VQuZzT5kjD_wjtnPSS9LzNg5SKCygirCnnzM3YMEn0S6uqi5B99Ii301m1O_7OQMutHE2t7b3b8_0CEuxQ7iFqfFkecmdb3ctcTSBFWMV3J-UrkrRXv8LErPQT2lpjBU3nezVHKlE2lA Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 3c6482bb91c24939ba18c03a3e5bb18c Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1529918992 Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:16:19.855786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:16:19.857524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:16:19.857524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1529918992 Sep 14 01:16:19.857524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 3c6482bb91c24939ba18c03a3e5bb18c Sep 14 01:16:19.857524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1529918992 Sep 14 01:16:19.857524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeShelveTestJSON-1529918992-project Sep 14 01:16:19.857524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:16:19.857524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:16:19.857524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: e4ad2d06f62246be8eb162257cbb4f8e Sep 14 01:16:19.857524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1529918992-project Sep 14 01:16:19.857524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:16:19.857524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Instance 291f27aa-9e42-4937-be7d-5e849d90e611 could not be found. Sep 14 01:16:19.857524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': '291f27aa-9e42-4937-be7d-5e849d90e611'} Sep 14 01:16:19.859269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:16:19.859269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:19.859269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:16:19.859269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:16:19.859269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:16:19.859269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:16:19.859269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:16:19.859269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:16:19.859269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:16:19.859269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:16:19.859269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 291f27aa-9e42-4937-be7d-5e849d90e611 could not be found. Sep 14 01:16:19.859269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:19.859269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:19.859269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:19.859269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:19.859269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:19.859269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:19.859269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:16:19.859269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:16:19.859269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:16:19.861012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:16:19.861012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:16:19.861012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:16:19.861012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:16:19.861012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:16:19.861012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:16:19.861012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:16:19.861012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 291f27aa-9e42-4937-be7d-5e849d90e611 could not be found. Sep 14 01:16:19.861012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:19.861012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:19.861012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:19.861012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:19.861012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:19.861012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:19.861012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:16:19.861012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:16:19.861012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 291f27aa-9e42-4937-be7d-5e849d90e611 could not be found. Sep 14 01:16:19.861012 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:19.863482 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4fd8a5d4-4776-4bc8-884e-b019357d8d3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Returning 404 to user: Instance 291f27aa-9e42-4937-be7d-5e849d90e611 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:16:19.864375 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4fd8a5d4-4776-4bc8-884e-b019357d8d3f tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 404 len: 111 microversion: 2.20 time: 0.072465 Sep 14 01:16:19.864928 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 542/1091] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:16:19 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 01:16:19.873720 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a0c486bd-6631-459b-a815-bb1727640353 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '.version_select at 0x7f504b6a1550>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:19.902697 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a0c486bd-6631-459b-a815-bb1727640353 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1750068040" status: 204 len: 0 microversion: 2.20 time: 0.032644 Sep 14 01:16:19.903280 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 550/1092] 10.222.0.42 () {60 vars in 1262 bytes} [Wed Sep 14 01:16:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1750068040 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 01:16:22.216944 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-075d8503-5936-4d8e-abc8-d5b512ebb24c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:22.218123 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-075d8503-5936-4d8e-abc8-d5b512ebb24c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:22.228422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-075d8503-5936-4d8e-abc8-d5b512ebb24c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:22.228981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-075d8503-5936-4d8e-abc8-d5b512ebb24c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:22.229332 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-075d8503-5936-4d8e-abc8-d5b512ebb24c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:22.230028 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-075d8503-5936-4d8e-abc8-d5b512ebb24c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:22.230473 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-075d8503-5936-4d8e-abc8-d5b512ebb24c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:22.230891 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-075d8503-5936-4d8e-abc8-d5b512ebb24c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:22.253351 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-075d8503-5936-4d8e-abc8-d5b512ebb24c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] HTTP exception thrown: Instance 291f27aa-9e42-4937-be7d-5e849d90e611 could not be found. Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-075d8503-5936-4d8e-abc8-d5b512ebb24c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Request method failure captured: Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: DELETE /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 HTTP/1.1 Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISi5NAtlwNVAUPorDKGIaO0iprs9LJQxC18VQuZzT5kjD_wjtnPSS9LzNg5SKCygirCnnzM3YMEn0S6uqi5B99Ii301m1O_7OQMutHE2t7b3b8_0CEuxQ7iFqfFkecmdb3ctcTSBFWMV3J-UrkrRXv8LErPQT2lpjBU3nezVHKlE2lA Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 3c6482bb91c24939ba18c03a3e5bb18c Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1529918992 Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:16:22.254929 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:16:22.256699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:16:22.256699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1529918992 Sep 14 01:16:22.256699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 3c6482bb91c24939ba18c03a3e5bb18c Sep 14 01:16:22.256699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1529918992 Sep 14 01:16:22.256699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeShelveTestJSON-1529918992-project Sep 14 01:16:22.256699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:16:22.256699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:16:22.256699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: e4ad2d06f62246be8eb162257cbb4f8e Sep 14 01:16:22.256699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1529918992-project Sep 14 01:16:22.256699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:16:22.256699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Instance 291f27aa-9e42-4937-be7d-5e849d90e611 could not be found. Sep 14 01:16:22.256699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': '291f27aa-9e42-4937-be7d-5e849d90e611'} Sep 14 01:16:22.260967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:16:22.260967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:22.260967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:16:22.260967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:16:22.260967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:16:22.260967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:16:22.260967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:16:22.260967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:16:22.260967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:16:22.260967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:16:22.260967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 291f27aa-9e42-4937-be7d-5e849d90e611 could not be found. Sep 14 01:16:22.260967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:22.260967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:22.260967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:22.260967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:22.260967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:22.260967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:22.260967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:16:22.260967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:16:22.260967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:16:22.262475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:16:22.262475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 01:16:22.262475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 01:16:22.262475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 01:16:22.262475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 01:16:22.262475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:16:22.262475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:16:22.262475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:16:22.262475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:16:22.262475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 291f27aa-9e42-4937-be7d-5e849d90e611 could not be found. Sep 14 01:16:22.262475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:22.262475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:22.262475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:22.262475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:22.262475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:22.262475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:22.262475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:16:22.262475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:16:22.262475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 291f27aa-9e42-4937-be7d-5e849d90e611 could not be found. Sep 14 01:16:22.262475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:22.263997 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-075d8503-5936-4d8e-abc8-d5b512ebb24c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Returning 404 to user: Instance 291f27aa-9e42-4937-be7d-5e849d90e611 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:16:22.263997 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-075d8503-5936-4d8e-abc8-d5b512ebb24c tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "DELETE /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 404 len: 111 microversion: 2.20 time: 0.043370 Sep 14 01:16:22.263997 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 543/1093] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Sep 14 01:16:22 2022] DELETE /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 01:16:22.269849 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-28ab4a7b-47d9-4145-bbc5-fb20c6a19c44 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:22.272733 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-28ab4a7b-47d9-4145-bbc5-fb20c6a19c44 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: 291f27aa-9e42-4937-be7d-5e849d90e611] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:22.281337 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-28ab4a7b-47d9-4145-bbc5-fb20c6a19c44 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:22.281954 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-28ab4a7b-47d9-4145-bbc5-fb20c6a19c44 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:22.282507 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-28ab4a7b-47d9-4145-bbc5-fb20c6a19c44 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:22.283369 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-28ab4a7b-47d9-4145-bbc5-fb20c6a19c44 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:22.283969 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-28ab4a7b-47d9-4145-bbc5-fb20c6a19c44 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:22.284491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-28ab4a7b-47d9-4145-bbc5-fb20c6a19c44 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:22.300456 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-28ab4a7b-47d9-4145-bbc5-fb20c6a19c44 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] HTTP exception thrown: Instance 291f27aa-9e42-4937-be7d-5e849d90e611 could not be found. Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-28ab4a7b-47d9-4145-bbc5-fb20c6a19c44 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Request method failure captured: Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 HTTP/1.1 Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISi5NAtlwNVAUPorDKGIaO0iprs9LJQxC18VQuZzT5kjD_wjtnPSS9LzNg5SKCygirCnnzM3YMEn0S6uqi5B99Ii301m1O_7OQMutHE2t7b3b8_0CEuxQ7iFqfFkecmdb3ctcTSBFWMV3J-UrkrRXv8LErPQT2lpjBU3nezVHKlE2lA Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 3c6482bb91c24939ba18c03a3e5bb18c Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1529918992 Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:16:22.302125 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:16:22.303843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:16:22.303843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1529918992 Sep 14 01:16:22.303843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 3c6482bb91c24939ba18c03a3e5bb18c Sep 14 01:16:22.303843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1529918992 Sep 14 01:16:22.303843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-AttachVolumeShelveTestJSON-1529918992-project Sep 14 01:16:22.303843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:16:22.303843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:16:22.303843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: e4ad2d06f62246be8eb162257cbb4f8e Sep 14 01:16:22.303843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1529918992-project Sep 14 01:16:22.303843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:16:22.303843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance 291f27aa-9e42-4937-be7d-5e849d90e611 could not be found. Sep 14 01:16:22.303843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': '291f27aa-9e42-4937-be7d-5e849d90e611'} Sep 14 01:16:22.304796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:16:22.304796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:22.304796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:16:22.304796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:16:22.304796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:16:22.304796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:16:22.304796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:16:22.304796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:16:22.304796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:16:22.304796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:16:22.304796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 291f27aa-9e42-4937-be7d-5e849d90e611 could not be found. Sep 14 01:16:22.304796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:22.304796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:22.304796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:22.304796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:22.304796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:22.304796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:22.304796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:16:22.304796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:16:22.304796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:16:22.306285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:16:22.306285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:16:22.306285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:16:22.306285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:16:22.306285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:16:22.306285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:16:22.306285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:16:22.306285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 291f27aa-9e42-4937-be7d-5e849d90e611 could not be found. Sep 14 01:16:22.306285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:22.306285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:22.306285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:22.306285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:22.306285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:22.306285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:22.306285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:16:22.306285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:16:22.306285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 291f27aa-9e42-4937-be7d-5e849d90e611 could not be found. Sep 14 01:16:22.306285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:22.307729 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-28ab4a7b-47d9-4145-bbc5-fb20c6a19c44 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Returning 404 to user: Instance 291f27aa-9e42-4937-be7d-5e849d90e611 could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:16:22.307729 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-28ab4a7b-47d9-4145-bbc5-fb20c6a19c44 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611" status: 404 len: 111 microversion: 2.20 time: 0.041239 Sep 14 01:16:22.316937 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 551/1094] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:16:22 2022] GET /compute/v2.1/servers/291f27aa-9e42-4937-be7d-5e849d90e611 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 01:16:23.494964 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7e2589ed-5bc2-46db-bf84-c9523f1cff3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:23.495448 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7e2589ed-5bc2-46db-bf84-c9523f1cff3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:23.503260 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7e2589ed-5bc2-46db-bf84-c9523f1cff3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:23.503788 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7e2589ed-5bc2-46db-bf84-c9523f1cff3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:23.504823 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7e2589ed-5bc2-46db-bf84-c9523f1cff3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:23.505741 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7e2589ed-5bc2-46db-bf84-c9523f1cff3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:23.506579 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7e2589ed-5bc2-46db-bf84-c9523f1cff3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:23.507040 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7e2589ed-5bc2-46db-bf84-c9523f1cff3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:23.523252 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-7e2589ed-5bc2-46db-bf84-c9523f1cff3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] HTTP exception thrown: Instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 could not be found. Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7e2589ed-5bc2-46db-bf84-c9523f1cff3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Request method failure captured: Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: DELETE /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 HTTP/1.1 Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISi5NAtlwNVAUPorDKGIaO0iprs9LJQxC18VQuZzT5kjD_wjtnPSS9LzNg5SKCygirCnnzM3YMEn0S6uqi5B99Ii301m1O_7OQMutHE2t7b3b8_0CEuxQ7iFqfFkecmdb3ctcTSBFWMV3J-UrkrRXv8LErPQT2lpjBU3nezVHKlE2lA Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 3c6482bb91c24939ba18c03a3e5bb18c Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1529918992 Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:16:23.525242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:16:23.526981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:16:23.526981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1529918992 Sep 14 01:16:23.526981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 3c6482bb91c24939ba18c03a3e5bb18c Sep 14 01:16:23.526981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1529918992 Sep 14 01:16:23.526981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-AttachVolumeShelveTestJSON-1529918992-project Sep 14 01:16:23.526981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:16:23.526981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:16:23.526981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: e4ad2d06f62246be8eb162257cbb4f8e Sep 14 01:16:23.526981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1529918992-project Sep 14 01:16:23.526981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:16:23.526981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 could not be found. Sep 14 01:16:23.526981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': 'd02da4a4-64f7-47c0-a48f-9cdb71f30df9'} Sep 14 01:16:23.530875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:16:23.530875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:23.530875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:16:23.530875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:16:23.530875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:16:23.530875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:16:23.530875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:16:23.530875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:16:23.530875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:16:23.530875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:16:23.530875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 could not be found. Sep 14 01:16:23.530875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:23.530875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:23.530875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:23.530875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:23.530875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:23.530875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:23.530875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:16:23.530875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:16:23.530875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:16:23.532611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:16:23.532611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 01:16:23.532611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 01:16:23.532611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 01:16:23.532611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 01:16:23.532611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:16:23.532611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:16:23.532611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:16:23.532611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:16:23.532611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 could not be found. Sep 14 01:16:23.532611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:23.532611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:23.532611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:23.532611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:23.532611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:23.532611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:23.532611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:16:23.532611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:16:23.532611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 could not be found. Sep 14 01:16:23.532611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:23.534115 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7e2589ed-5bc2-46db-bf84-c9523f1cff3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Returning 404 to user: Instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:16:23.534115 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7e2589ed-5bc2-46db-bf84-c9523f1cff3e tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 404 len: 111 microversion: 2.20 time: 0.035712 Sep 14 01:16:23.534115 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 544/1095] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Sep 14 01:16:23 2022] DELETE /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 01:16:23.538430 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-1dad2430-508f-48f3-b3a8-49a70dc11911 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:23.539163 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-1dad2430-508f-48f3-b3a8-49a70dc11911 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] [instance: d02da4a4-64f7-47c0-a48f-9cdb71f30df9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:23.546064 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1dad2430-508f-48f3-b3a8-49a70dc11911 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:23.546657 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1dad2430-508f-48f3-b3a8-49a70dc11911 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:23.547201 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1dad2430-508f-48f3-b3a8-49a70dc11911 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:23.548043 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1dad2430-508f-48f3-b3a8-49a70dc11911 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:23.548607 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1dad2430-508f-48f3-b3a8-49a70dc11911 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:23.549321 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1dad2430-508f-48f3-b3a8-49a70dc11911 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:23.563986 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-1dad2430-508f-48f3-b3a8-49a70dc11911 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] HTTP exception thrown: Instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 could not be found. Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-1dad2430-508f-48f3-b3a8-49a70dc11911 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Request method failure captured: Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 HTTP/1.1 Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISi5NAtlwNVAUPorDKGIaO0iprs9LJQxC18VQuZzT5kjD_wjtnPSS9LzNg5SKCygirCnnzM3YMEn0S6uqi5B99Ii301m1O_7OQMutHE2t7b3b8_0CEuxQ7iFqfFkecmdb3ctcTSBFWMV3J-UrkrRXv8LErPQT2lpjBU3nezVHKlE2lA Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 3c6482bb91c24939ba18c03a3e5bb18c Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1529918992 Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:16:23.565584 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:16:23.567108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3c6482bb91c24939ba18c03a3e5bb18c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:16:23.567108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1529918992 Sep 14 01:16:23.567108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 3c6482bb91c24939ba18c03a3e5bb18c Sep 14 01:16:23.567108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1529918992 Sep 14 01:16:23.567108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-AttachVolumeShelveTestJSON-1529918992-project Sep 14 01:16:23.567108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:16:23.567108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:16:23.567108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: e4ad2d06f62246be8eb162257cbb4f8e Sep 14 01:16:23.567108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1529918992-project Sep 14 01:16:23.567108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:16:23.567108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 could not be found. Sep 14 01:16:23.567108 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': 'd02da4a4-64f7-47c0-a48f-9cdb71f30df9'} Sep 14 01:16:23.567891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:16:23.567891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:23.567891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:16:23.567891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:16:23.567891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:16:23.567891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:16:23.567891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:16:23.567891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:16:23.567891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:16:23.567891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:16:23.567891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 could not be found. Sep 14 01:16:23.567891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:23.567891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:23.567891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:23.567891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:23.567891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:23.567891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:23.567891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:16:23.567891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:16:23.567891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:16:23.569158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:16:23.569158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:16:23.569158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:16:23.569158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:16:23.569158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:16:23.569158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:16:23.569158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:16:23.569158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 could not be found. Sep 14 01:16:23.569158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:23.569158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:23.569158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:23.569158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:23.569158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:23.569158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:23.569158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:16:23.569158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:16:23.569158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 could not be found. Sep 14 01:16:23.569158 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:16:23.570287 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-1dad2430-508f-48f3-b3a8-49a70dc11911 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] Returning 404 to user: Instance d02da4a4-64f7-47c0-a48f-9cdb71f30df9 could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:16:23.570287 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-1dad2430-508f-48f3-b3a8-49a70dc11911 tempest-AttachVolumeShelveTestJSON-1529918992 tempest-AttachVolumeShelveTestJSON-1529918992-project] 10.222.0.42 "GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9" status: 404 len: 111 microversion: 2.20 time: 0.034250 Sep 14 01:16:23.570287 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 552/1096] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 01:16:23 2022] GET /compute/v2.1/servers/d02da4a4-64f7-47c0-a48f-9cdb71f30df9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 01:16:51.472783 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-258be811-b550-4029-9dd4-9fd27b619829 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1863250861"}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:16:51.473347 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-258be811-b550-4029-9dd4-9fd27b619829 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:51.475782 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:16:51.476659 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:16:51.484827 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-258be811-b550-4029-9dd4-9fd27b619829 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:51.485562 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-258be811-b550-4029-9dd4-9fd27b619829 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:51.486185 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-258be811-b550-4029-9dd4-9fd27b619829 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:51.487179 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-258be811-b550-4029-9dd4-9fd27b619829 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:51.487853 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-258be811-b550-4029-9dd4-9fd27b619829 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:51.488467 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-258be811-b550-4029-9dd4-9fd27b619829 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:51.631183 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.network.security_group_api [None req-258be811-b550-4029-9dd4-9fd27b619829 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Removing security group 6b31a37d-28bd-4092-9d76-f4964a59a1e9 from port 78292043-7571-4bbd-b478-4125b485b189 Sep 14 01:16:51.958346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-258be811-b550-4029-9dd4-9fd27b619829 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "POST /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/action" status: 202 len: 0 microversion: 2.1 time: 0.489474 Sep 14 01:16:51.959410 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 545/1097] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 01:16:51 2022] POST /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 01:16:51.989648 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:16:51.991801 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:16:52.279636 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-2b4f4e22-0b4c-440f-86dc-ba61f3869ee0 req-b2da8da6-122d-4627-9c4d-afd2226bdae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c532d078-01eb-4150-8869-3c33a457898c", "tag": "78292043-7571-4bbd-b478-4125b485b189"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:16:52.289826 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-2b4f4e22-0b4c-440f-86dc-ba61f3869ee0 req-b2da8da6-122d-4627-9c4d-afd2226bdae4 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:52.290313 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-2b4f4e22-0b4c-440f-86dc-ba61f3869ee0 req-b2da8da6-122d-4627-9c4d-afd2226bdae4 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:52.290746 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-2b4f4e22-0b4c-440f-86dc-ba61f3869ee0 req-b2da8da6-122d-4627-9c4d-afd2226bdae4 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:52.303618 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-2b4f4e22-0b4c-440f-86dc-ba61f3869ee0 req-b2da8da6-122d-4627-9c4d-afd2226bdae4 service nova] Creating event network-changed:78292043-7571-4bbd-b478-4125b485b189 for instance c532d078-01eb-4150-8869-3c33a457898c on hv-cinder-85752 Sep 14 01:16:52.308729 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-2b4f4e22-0b4c-440f-86dc-ba61f3869ee0 req-b2da8da6-122d-4627-9c4d-afd2226bdae4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.326287 Sep 14 01:16:52.309314 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 553/1098] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:16:53.544611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-072030b2-35e7-4631-a3a5-775990ac4f2e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:53.545123 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-072030b2-35e7-4631-a3a5-775990ac4f2e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:53.552470 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-072030b2-35e7-4631-a3a5-775990ac4f2e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:53.552963 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-072030b2-35e7-4631-a3a5-775990ac4f2e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:53.553405 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-072030b2-35e7-4631-a3a5-775990ac4f2e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:53.554110 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-072030b2-35e7-4631-a3a5-775990ac4f2e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:53.554570 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-072030b2-35e7-4631-a3a5-775990ac4f2e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:53.554995 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-072030b2-35e7-4631-a3a5-775990ac4f2e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:53.645431 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-072030b2-35e7-4631-a3a5-775990ac4f2e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lazy-loading 'services' on Instance uuid c532d078-01eb-4150-8869-3c33a457898c {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:16:53.739134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-072030b2-35e7-4631-a3a5-775990ac4f2e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/os-volume_attachments/d7bb3e18-9b4e-40c0-b310-58f821bc65d5" status: 202 len: 0 microversion: 2.1 time: 0.200449 Sep 14 01:16:53.739936 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 546/1099] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 01:16:53 2022] DELETE /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/os-volume_attachments/d7bb3e18-9b4e-40c0-b310-58f821bc65d5 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:16:53.749668 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ec4634f7-fa91-4c62-be3f-e5ca6a93822b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:53.752119 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ec4634f7-fa91-4c62-be3f-e5ca6a93822b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:53.758340 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec4634f7-fa91-4c62-be3f-e5ca6a93822b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:53.759287 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec4634f7-fa91-4c62-be3f-e5ca6a93822b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:53.759786 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec4634f7-fa91-4c62-be3f-e5ca6a93822b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:53.760695 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec4634f7-fa91-4c62-be3f-e5ca6a93822b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:53.761149 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec4634f7-fa91-4c62-be3f-e5ca6a93822b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:53.761571 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ec4634f7-fa91-4c62-be3f-e5ca6a93822b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:53.792771 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ec4634f7-fa91-4c62-be3f-e5ca6a93822b tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048199 Sep 14 01:16:53.793388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 554/1100] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 01:16:53 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:16:54.324533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-198aa405-ec40-4ae9-bba8-5e953275927d req-d5f2efaf-9744-49a0-b3aa-954c37316859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c532d078-01eb-4150-8869-3c33a457898c", "tag": "78292043-7571-4bbd-b478-4125b485b189"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:16:54.334864 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-198aa405-ec40-4ae9-bba8-5e953275927d req-d5f2efaf-9744-49a0-b3aa-954c37316859 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:54.335344 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-198aa405-ec40-4ae9-bba8-5e953275927d req-d5f2efaf-9744-49a0-b3aa-954c37316859 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:54.335813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-198aa405-ec40-4ae9-bba8-5e953275927d req-d5f2efaf-9744-49a0-b3aa-954c37316859 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:54.348750 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-198aa405-ec40-4ae9-bba8-5e953275927d req-d5f2efaf-9744-49a0-b3aa-954c37316859 service nova] Creating event network-changed:78292043-7571-4bbd-b478-4125b485b189 for instance c532d078-01eb-4150-8869-3c33a457898c on hv-cinder-85752 Sep 14 01:16:54.353892 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-198aa405-ec40-4ae9-bba8-5e953275927d req-d5f2efaf-9744-49a0-b3aa-954c37316859 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033390 Sep 14 01:16:54.354727 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 547/1101] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:16:54.806891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7047940c-acdd-41de-b13b-2135000fd591 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:54.809716 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7047940c-acdd-41de-b13b-2135000fd591 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:54.817075 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7047940c-acdd-41de-b13b-2135000fd591 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:54.817795 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7047940c-acdd-41de-b13b-2135000fd591 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:54.818405 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7047940c-acdd-41de-b13b-2135000fd591 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:54.819272 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7047940c-acdd-41de-b13b-2135000fd591 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:54.819924 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7047940c-acdd-41de-b13b-2135000fd591 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:54.820520 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7047940c-acdd-41de-b13b-2135000fd591 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:54.852305 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7047940c-acdd-41de-b13b-2135000fd591 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049273 Sep 14 01:16:54.853162 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 555/1102] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 01:16:54 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:16:55.866606 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5307b9d8-4012-47a3-a3ce-744be2d3738a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:55.868953 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5307b9d8-4012-47a3-a3ce-744be2d3738a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:55.876324 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5307b9d8-4012-47a3-a3ce-744be2d3738a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:55.876801 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5307b9d8-4012-47a3-a3ce-744be2d3738a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:55.877230 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5307b9d8-4012-47a3-a3ce-744be2d3738a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:55.877915 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5307b9d8-4012-47a3-a3ce-744be2d3738a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:55.878374 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5307b9d8-4012-47a3-a3ce-744be2d3738a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:55.878791 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5307b9d8-4012-47a3-a3ce-744be2d3738a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:55.911932 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5307b9d8-4012-47a3-a3ce-744be2d3738a tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050265 Sep 14 01:16:55.915734 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 548/1103] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 01:16:55 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:16:56.924976 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-dca8ccae-08fc-4a08-8e14-993a1b0a89ae tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:56.928955 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-dca8ccae-08fc-4a08-8e14-993a1b0a89ae tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:56.936282 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-dca8ccae-08fc-4a08-8e14-993a1b0a89ae tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:56.937376 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-dca8ccae-08fc-4a08-8e14-993a1b0a89ae tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:56.937814 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-dca8ccae-08fc-4a08-8e14-993a1b0a89ae tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:56.938722 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-dca8ccae-08fc-4a08-8e14-993a1b0a89ae tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:56.939189 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-dca8ccae-08fc-4a08-8e14-993a1b0a89ae tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:56.939646 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-dca8ccae-08fc-4a08-8e14-993a1b0a89ae tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:56.974420 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-dca8ccae-08fc-4a08-8e14-993a1b0a89ae tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053871 Sep 14 01:16:56.978944 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 556/1104] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 01:16:56 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 01:16:56.988854 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5e2587b0-daa9-4039-995e-741fabfae5b8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:56.989499 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5e2587b0-daa9-4039-995e-741fabfae5b8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:56.996173 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e2587b0-daa9-4039-995e-741fabfae5b8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:56.996664 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e2587b0-daa9-4039-995e-741fabfae5b8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:56.997169 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e2587b0-daa9-4039-995e-741fabfae5b8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:56.997872 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e2587b0-daa9-4039-995e-741fabfae5b8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:56.998370 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e2587b0-daa9-4039-995e-741fabfae5b8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:56.998805 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e2587b0-daa9-4039-995e-741fabfae5b8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:57.079381 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-5e2587b0-daa9-4039-995e-741fabfae5b8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] HTTP exception thrown: Instance c532d078-01eb-4150-8869-3c33a457898c is not attached to volume d7bb3e18-9b4e-40c0-b310-58f821bc65d5 Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5e2587b0-daa9-4039-995e-741fabfae5b8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Request method failure captured: Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: DELETE /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/os-volume_attachments/d7bb3e18-9b4e-40c0-b310-58f821bc65d5 HTTP/1.1 Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISqytdWHgMc0HDk4cWQLxoNpTDVlU2jeuM1ZiJ2mWCDwfAsLnveJXYCJPQ8AXCOpaQBakA56AhYC6e6VEt1XY6mLHsVjSeuuMcpm2Utb68GgnZw2on96mntiqDmpeLKRqqUlIMSoTG8fXtTbJPPint9EKOiYeBwt7O1Ubocx3UhpjoE Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: f93905695d7a4f8495534c38a7bebfa4 Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-TestMinimumBasicScenario-1612267601 Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:16:57.081773 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:16:57.083480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f93905695d7a4f8495534c38a7bebfa4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f93905695d7a4f8495534c38a7bebfa4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f93905695d7a4f8495534c38a7bebfa4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f93905695d7a4f8495534c38a7bebfa4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:16:57.083480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-TestMinimumBasicScenario-1612267601 Sep 14 01:16:57.083480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: f93905695d7a4f8495534c38a7bebfa4 Sep 14 01:16:57.083480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1612267601 Sep 14 01:16:57.083480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-TestMinimumBasicScenario-1612267601-project Sep 14 01:16:57.083480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:16:57.083480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:16:57.083480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: f8d750f711d34f80816f124cb3d1f4b4 Sep 14 01:16:57.083480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-TestMinimumBasicScenario-1612267601-project Sep 14 01:16:57.083480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:16:57.083480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Instance c532d078-01eb-4150-8869-3c33a457898c is not attached to volume d7bb3e18-9b4e-40c0-b310-58f821bc65d5 Sep 14 01:16:57.084428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'server_id': 'c532d078-01eb-4150-8869-3c33a457898c', 'id': 'd7bb3e18-9b4e-40c0-b310-58f821bc65d5'} Sep 14 01:16:57.084428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:16:57.084428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:57.084428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 14 01:16:57.084428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 14 01:16:57.084428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 01:16:57.084428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 01:16:57.084428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 14 01:16:57.084428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 14 01:16:57.084428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d7bb3e18-9b4e-40c0-b310-58f821bc65d5. Sep 14 01:16:57.084428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:57.084428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:57.084428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:57.084428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:57.084428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:57.084428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:57.084428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:16:57.084428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:16:57.084428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:16:57.085922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:16:57.085922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 14 01:16:57.085922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 01:16:57.085922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c532d078-01eb-4150-8869-3c33a457898c is not attached to volume d7bb3e18-9b4e-40c0-b310-58f821bc65d5 Sep 14 01:16:57.085922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:57.085922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:16:57.085922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:57.085922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:16:57.085922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:16:57.085922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:16:57.085922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:16:57.085922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:16:57.085922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c532d078-01eb-4150-8869-3c33a457898c is not attached to volume d7bb3e18-9b4e-40c0-b310-58f821bc65d5 Sep 14 01:16:57.085922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:16:57.085922 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5e2587b0-daa9-4039-995e-741fabfae5b8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Returning 404 to user: Instance c532d078-01eb-4150-8869-3c33a457898c is not attached to volume d7bb3e18-9b4e-40c0-b310-58f821bc65d5 {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:16:57.087103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5e2587b0-daa9-4039-995e-741fabfae5b8 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/os-volume_attachments/d7bb3e18-9b4e-40c0-b310-58f821bc65d5" status: 404 len: 154 microversion: 2.1 time: 0.100938 Sep 14 01:16:57.087103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 549/1105] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 01:16:56 2022] DELETE /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c/os-volume_attachments/d7bb3e18-9b4e-40c0-b310-58f821bc65d5 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 01:16:59.300713 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8b4c0446-cf53-466c-a94c-c2a7c099c31d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:59.301344 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8b4c0446-cf53-466c-a94c-c2a7c099c31d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:59.307543 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8b4c0446-cf53-466c-a94c-c2a7c099c31d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:59.308057 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8b4c0446-cf53-466c-a94c-c2a7c099c31d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:59.308493 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8b4c0446-cf53-466c-a94c-c2a7c099c31d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:59.309182 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8b4c0446-cf53-466c-a94c-c2a7c099c31d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:59.309641 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8b4c0446-cf53-466c-a94c-c2a7c099c31d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:59.310070 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8b4c0446-cf53-466c-a94c-c2a7c099c31d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:59.334683 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8b4c0446-cf53-466c-a94c-c2a7c099c31d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Going to try to terminate instance {{(pid=120620) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:16:59.412550 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8b4c0446-cf53-466c-a94c-c2a7c099c31d tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 204 len: 0 microversion: 2.1 time: 0.115288 Sep 14 01:16:59.413733 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 557/1106] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:16:59 2022] DELETE /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 01:16:59.423184 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7cd55614-a11c-4d58-883e-fed5ca43f094 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:16:59.423840 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7cd55614-a11c-4d58-883e-fed5ca43f094 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:16:59.430455 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7cd55614-a11c-4d58-883e-fed5ca43f094 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:59.430940 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7cd55614-a11c-4d58-883e-fed5ca43f094 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:59.431380 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7cd55614-a11c-4d58-883e-fed5ca43f094 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:59.432164 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7cd55614-a11c-4d58-883e-fed5ca43f094 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:16:59.432646 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7cd55614-a11c-4d58-883e-fed5ca43f094 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:16:59.433096 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7cd55614-a11c-4d58-883e-fed5ca43f094 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:16:59.584556 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-7cd55614-a11c-4d58-883e-fed5ca43f094 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:16:59.593888 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7cd55614-a11c-4d58-883e-fed5ca43f094 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1554 microversion: 2.1 time: 0.174881 Sep 14 01:16:59.594225 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 550/1107] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:16:59 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:17:00.617847 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a1b58133-a4e8-4f8c-9432-3f0c91f930fb tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:17:00.618571 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a1b58133-a4e8-4f8c-9432-3f0c91f930fb tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:17:00.624855 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a1b58133-a4e8-4f8c-9432-3f0c91f930fb tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:17:00.625360 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a1b58133-a4e8-4f8c-9432-3f0c91f930fb tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:17:00.626540 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a1b58133-a4e8-4f8c-9432-3f0c91f930fb tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:17:00.627474 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a1b58133-a4e8-4f8c-9432-3f0c91f930fb tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:17:00.627959 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a1b58133-a4e8-4f8c-9432-3f0c91f930fb tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:17:00.628379 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a1b58133-a4e8-4f8c-9432-3f0c91f930fb tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:17:00.777609 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a1b58133-a4e8-4f8c-9432-3f0c91f930fb tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:17:00.786849 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a1b58133-a4e8-4f8c-9432-3f0c91f930fb tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1554 microversion: 2.1 time: 0.173134 Sep 14 01:17:00.799812 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 558/1108] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:17:00 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:17:01.814557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-83fe50aa-223a-409a-a392-1605d0ffa209 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:17:01.815173 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-83fe50aa-223a-409a-a392-1605d0ffa209 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:17:01.821646 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-83fe50aa-223a-409a-a392-1605d0ffa209 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:17:01.822128 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-83fe50aa-223a-409a-a392-1605d0ffa209 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:17:01.822563 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-83fe50aa-223a-409a-a392-1605d0ffa209 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:17:01.823258 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-83fe50aa-223a-409a-a392-1605d0ffa209 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:17:01.823745 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-83fe50aa-223a-409a-a392-1605d0ffa209 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:17:01.824172 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-83fe50aa-223a-409a-a392-1605d0ffa209 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:17:02.050530 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-83fe50aa-223a-409a-a392-1605d0ffa209 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8d750f711d34f80816f124cb3d1f4b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93905695d7a4f8495534c38a7bebfa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:17:02.063173 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-83fe50aa-223a-409a-a392-1605d0ffa209 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 200 len: 1554 microversion: 2.1 time: 0.252941 Sep 14 01:17:02.064325 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 551/1109] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:17:01 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 1554 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:17:02.331821 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-1653ccd4-7e2d-4dd1-ba3e-e2406dffdef2 req-dbcbda12-2af3-4dbc-bb20-e0825f7414f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c532d078-01eb-4150-8869-3c33a457898c", "name": "network-vif-deleted", "tag": "78292043-7571-4bbd-b478-4125b485b189"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:17:02.344015 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-1653ccd4-7e2d-4dd1-ba3e-e2406dffdef2 req-dbcbda12-2af3-4dbc-bb20-e0825f7414f6 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:17:02.345228 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-1653ccd4-7e2d-4dd1-ba3e-e2406dffdef2 req-dbcbda12-2af3-4dbc-bb20-e0825f7414f6 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:17:02.345912 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-1653ccd4-7e2d-4dd1-ba3e-e2406dffdef2 req-dbcbda12-2af3-4dbc-bb20-e0825f7414f6 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:17:02.357131 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-1653ccd4-7e2d-4dd1-ba3e-e2406dffdef2 req-dbcbda12-2af3-4dbc-bb20-e0825f7414f6 service nova] Creating event network-vif-deleted:78292043-7571-4bbd-b478-4125b485b189 for instance c532d078-01eb-4150-8869-3c33a457898c on hv-cinder-85752 Sep 14 01:17:02.362757 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-1653ccd4-7e2d-4dd1-ba3e-e2406dffdef2 req-dbcbda12-2af3-4dbc-bb20-e0825f7414f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034826 Sep 14 01:17:02.363370 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 559/1110] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:17:03.089283 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7f111eb9-c3f0-4168-8b39-3d71bdf3ed20 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:17:03.089849 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-7f111eb9-c3f0-4168-8b39-3d71bdf3ed20 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] [instance: c532d078-01eb-4150-8869-3c33a457898c] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:17:03.096542 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7f111eb9-c3f0-4168-8b39-3d71bdf3ed20 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:17:03.097045 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7f111eb9-c3f0-4168-8b39-3d71bdf3ed20 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:17:03.097476 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7f111eb9-c3f0-4168-8b39-3d71bdf3ed20 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:17:03.098157 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7f111eb9-c3f0-4168-8b39-3d71bdf3ed20 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:17:03.098603 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7f111eb9-c3f0-4168-8b39-3d71bdf3ed20 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:17:03.099024 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-7f111eb9-c3f0-4168-8b39-3d71bdf3ed20 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:17:03.114790 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-7f111eb9-c3f0-4168-8b39-3d71bdf3ed20 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] HTTP exception thrown: Instance c532d078-01eb-4150-8869-3c33a457898c could not be found. Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7f111eb9-c3f0-4168-8b39-3d71bdf3ed20 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Request method failure captured: Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c HTTP/1.1 Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISqytdWHgMc0HDk4cWQLxoNpTDVlU2jeuM1ZiJ2mWCDwfAsLnveJXYCJPQ8AXCOpaQBakA56AhYC6e6VEt1XY6mLHsVjSeuuMcpm2Utb68GgnZw2on96mntiqDmpeLKRqqUlIMSoTG8fXtTbJPPint9EKOiYeBwt7O1Ubocx3UhpjoE Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: f93905695d7a4f8495534c38a7bebfa4 Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-TestMinimumBasicScenario-1612267601 Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:17:03.116587 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:17:03.118048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f93905695d7a4f8495534c38a7bebfa4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f93905695d7a4f8495534c38a7bebfa4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f93905695d7a4f8495534c38a7bebfa4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f93905695d7a4f8495534c38a7bebfa4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:17:03.118048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-TestMinimumBasicScenario-1612267601 Sep 14 01:17:03.118048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: f93905695d7a4f8495534c38a7bebfa4 Sep 14 01:17:03.118048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1612267601 Sep 14 01:17:03.118048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-TestMinimumBasicScenario-1612267601-project Sep 14 01:17:03.118048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:17:03.118048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:17:03.118048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: f8d750f711d34f80816f124cb3d1f4b4 Sep 14 01:17:03.118048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-TestMinimumBasicScenario-1612267601-project Sep 14 01:17:03.118048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:17:03.118048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Instance c532d078-01eb-4150-8869-3c33a457898c could not be found. Sep 14 01:17:03.118048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': 'c532d078-01eb-4150-8869-3c33a457898c'} Sep 14 01:17:03.118831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:17:03.118831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:17:03.118831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:17:03.118831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:17:03.118831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:17:03.118831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:17:03.118831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:17:03.118831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:17:03.118831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:17:03.118831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:17:03.118831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c532d078-01eb-4150-8869-3c33a457898c could not be found. Sep 14 01:17:03.118831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:17:03.118831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:17:03.118831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:17:03.118831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:17:03.118831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:17:03.118831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:17:03.118831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:17:03.118831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:17:03.118831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:17:03.120312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:17:03.120312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:17:03.120312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:17:03.120312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:17:03.120312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:17:03.120312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:17:03.120312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:17:03.120312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c532d078-01eb-4150-8869-3c33a457898c could not be found. Sep 14 01:17:03.120312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:17:03.120312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:17:03.120312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:17:03.120312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:17:03.120312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:17:03.120312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:17:03.120312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:17:03.120312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:17:03.120312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c532d078-01eb-4150-8869-3c33a457898c could not be found. Sep 14 01:17:03.120312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:17:03.121728 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-7f111eb9-c3f0-4168-8b39-3d71bdf3ed20 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Returning 404 to user: Instance c532d078-01eb-4150-8869-3c33a457898c could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:17:03.121728 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-7f111eb9-c3f0-4168-8b39-3d71bdf3ed20 tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c" status: 404 len: 111 microversion: 2.1 time: 0.032725 Sep 14 01:17:03.121728 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 552/1111] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:17:03 2022] GET /compute/v2.1/servers/c532d078-01eb-4150-8869-3c33a457898c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:17:03.128277 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9f117a2d-eda8-4f32-9cdc-04c310ee058e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] Calling method '.version_select at 0x7f5043e1a550>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:17:03.147600 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9f117a2d-eda8-4f32-9cdc-04c310ee058e tempest-TestMinimumBasicScenario-1612267601 tempest-TestMinimumBasicScenario-1612267601-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-537043076" status: 202 len: 0 microversion: 2.1 time: 0.024133 Sep 14 01:17:03.148146 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 560/1112] 10.222.0.42 () {58 vars in 1269 bytes} [Wed Sep 14 01:17:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-537043076 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:17:25.880637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 01:17:25.881167 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Wed Sep 14 01:17:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.42) !!! Sep 14 01:17:25.883466 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=16 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:17:25.888128 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:17:26.306563 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-491deed9-43f1-4e36-bdca-9b1a74d57dc6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Action: 'create', calling method: .version_select at 0x7f5043e201f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2052138769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIr4A/lvHAGJKliitYVAyKsAXcP9/tj7Vhr3hoRc7tGgMAWLgatC/IIGpNIkSJ8GibF6MR2tX8cPd28XBVrNEzuOziojpX6fv02v9k7tR5Ev2JGoxf0wu4GZsz7TdbTb/Q=="}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:17:26.337543 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-491deed9-43f1-4e36-bdca-9b1a74d57dc6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Getting quotas for project b2d80d1c2758499da66a93e91f9c1311. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:17:26.345840 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-491deed9-43f1-4e36-bdca-9b1a74d57dc6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Getting quotas for user 9e0e8bab9899415c91d3b7122ab0a1d0 and project b2d80d1c2758499da66a93e91f9c1311. Resources: {'key_pairs'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:17:26.395248 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-491deed9-43f1-4e36-bdca-9b1a74d57dc6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.521427 Sep 14 01:17:26.397647 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 553/1113] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Sep 14 01:17:25 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:17:27.505978 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 01:17:27.506552 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Wed Sep 14 01:17:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.42) !!! Sep 14 01:17:27.507322 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:17:27.508483 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:17:27.698025 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a11b8bcd-bbaf-494b-b61d-7686fe96f159 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Action: 'create', calling method: .version_select at 0x7f5043c89d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-787735033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQBqAQ6rnqY0O+VB9UDgthiNTwdUAuE2C7DouFLhilzV4wNQIXOjiDnlZDRcUSuwWDrxR1LKJcRKEMLkewPoaarFwDtOsAJ3earc8pDMkdwZn6UZYcXWvYAXmvjYE7HZg=="}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:17:27.728785 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-a11b8bcd-bbaf-494b-b61d-7686fe96f159 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Getting quotas for project 6c0d5a6539764b53852b5741347734a8. Resources: {'key_pairs'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:17:27.746071 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-a11b8bcd-bbaf-494b-b61d-7686fe96f159 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Getting quotas for user b1494511685b47519f4aa0674009fbfc and project 6c0d5a6539764b53852b5741347734a8. Resources: {'key_pairs'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:17:27.776833 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a11b8bcd-bbaf-494b-b61d-7686fe96f159 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.272783 Sep 14 01:17:27.779708 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 561/1114] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Sep 14 01:17:27 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:18:12.161819 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=4 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:18:12.162563 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:18:12.166516 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-72d1a71d-d117-4e16-9540-9d03e0ccfba6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1901741256", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2052138769", "security_groups": [{"name": "tempest-secgroup-smoke-1755717314"}], "networks": [{"uuid": "b8836f13-10c9-4828-a7dd-5ebe348d4f85"}], "block_device_mapping_v2": [{"uuid": "cd4b1274-ffc6-4f74-9efa-6630376bdac5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:18:12.284183 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-72d1a71d-d117-4e16-9540-9d03e0ccfba6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] validate_networks() for [('b8836f13-10c9-4828-a7dd-5ebe348d4f85', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:18:12.765354 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-72d1a71d-d117-4e16-9540-9d03e0ccfba6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:18:12.765774 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-72d1a71d-d117-4e16-9540-9d03e0ccfba6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:18:12.766243 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-72d1a71d-d117-4e16-9540-9d03e0ccfba6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:18:12.766646 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-72d1a71d-d117-4e16-9540-9d03e0ccfba6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:18:12.767052 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-72d1a71d-d117-4e16-9540-9d03e0ccfba6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:18:12.775656 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-72d1a71d-d117-4e16-9540-9d03e0ccfba6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:12.776134 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-72d1a71d-d117-4e16-9540-9d03e0ccfba6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:12.776567 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-72d1a71d-d117-4e16-9540-9d03e0ccfba6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:12.777288 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-72d1a71d-d117-4e16-9540-9d03e0ccfba6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:12.777737 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-72d1a71d-d117-4e16-9540-9d03e0ccfba6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:12.778161 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-72d1a71d-d117-4e16-9540-9d03e0ccfba6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:12.795898 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-72d1a71d-d117-4e16-9540-9d03e0ccfba6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Getting quotas for project b2d80d1c2758499da66a93e91f9c1311. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:18:12.799734 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-72d1a71d-d117-4e16-9540-9d03e0ccfba6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Getting quotas for user 9e0e8bab9899415c91d3b7122ab0a1d0 and project b2d80d1c2758499da66a93e91f9c1311. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:18:12.855870 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-72d1a71d-d117-4e16-9540-9d03e0ccfba6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:18:12.857959 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-72d1a71d-d117-4e16-9540-9d03e0ccfba6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cd4b1274-ffc6-4f74-9efa-6630376bdac5',volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:18:12.989576 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-72d1a71d-d117-4e16-9540-9d03e0ccfba6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.829020 Sep 14 01:18:12.990341 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 554/1115] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 01:18:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 01:18:13.001809 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-f5cce711-6cfa-4611-b6bf-86d026f0e5d4 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:13.002627 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-f5cce711-6cfa-4611-b6bf-86d026f0e5d4 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:13.004616 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=4 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:18:13.006430 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:18:13.063842 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-f5cce711-6cfa-4611-b6bf-86d026f0e5d4 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:13.070824 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-f5cce711-6cfa-4611-b6bf-86d026f0e5d4 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1089 microversion: 2.1 time: 0.073005 Sep 14 01:18:13.071528 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 562/1116] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:12 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:14.093728 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e78c66e6-86d5-40c5-a8c6-e10bc77d13e0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:14.094338 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e78c66e6-86d5-40c5-a8c6-e10bc77d13e0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:14.101395 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e78c66e6-86d5-40c5-a8c6-e10bc77d13e0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:14.101882 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e78c66e6-86d5-40c5-a8c6-e10bc77d13e0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:14.102458 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e78c66e6-86d5-40c5-a8c6-e10bc77d13e0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:14.103730 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e78c66e6-86d5-40c5-a8c6-e10bc77d13e0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:14.104201 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e78c66e6-86d5-40c5-a8c6-e10bc77d13e0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:14.104630 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e78c66e6-86d5-40c5-a8c6-e10bc77d13e0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:14.190788 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e78c66e6-86d5-40c5-a8c6-e10bc77d13e0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:14.199869 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e78c66e6-86d5-40c5-a8c6-e10bc77d13e0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1195 microversion: 2.1 time: 0.109908 Sep 14 01:18:14.200684 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 555/1117] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:14 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1195 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:15.224074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-90d158a1-05ba-4dc4-8336-17040d3dfdc5 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:15.224839 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-90d158a1-05ba-4dc4-8336-17040d3dfdc5 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:15.237393 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-90d158a1-05ba-4dc4-8336-17040d3dfdc5 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:15.237898 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-90d158a1-05ba-4dc4-8336-17040d3dfdc5 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:15.238340 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-90d158a1-05ba-4dc4-8336-17040d3dfdc5 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:15.239045 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-90d158a1-05ba-4dc4-8336-17040d3dfdc5 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:15.239594 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-90d158a1-05ba-4dc4-8336-17040d3dfdc5 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:15.240019 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-90d158a1-05ba-4dc4-8336-17040d3dfdc5 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:15.376499 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-90d158a1-05ba-4dc4-8336-17040d3dfdc5 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:15.385581 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-90d158a1-05ba-4dc4-8336-17040d3dfdc5 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1261 microversion: 2.1 time: 0.164520 Sep 14 01:18:15.386598 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 563/1118] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:15 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:15.662448 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-c1e07c72-447a-499f-a922-c0e2fee8d2c7 req-27dcedf5-82b4-4406-92c5-c0579495d8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5047389f-d232-432f-a459-bc4b023c358d", "tag": "95cbc616-90a4-4fe0-8288-92d9ab2f32b3"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:18:15.680035 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-c1e07c72-447a-499f-a922-c0e2fee8d2c7 req-27dcedf5-82b4-4406-92c5-c0579495d8f2 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:15.680632 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-c1e07c72-447a-499f-a922-c0e2fee8d2c7 req-27dcedf5-82b4-4406-92c5-c0579495d8f2 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:15.681131 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-c1e07c72-447a-499f-a922-c0e2fee8d2c7 req-27dcedf5-82b4-4406-92c5-c0579495d8f2 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:15.693482 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-c1e07c72-447a-499f-a922-c0e2fee8d2c7 req-27dcedf5-82b4-4406-92c5-c0579495d8f2 service nova] Creating event network-changed:95cbc616-90a4-4fe0-8288-92d9ab2f32b3 for instance 5047389f-d232-432f-a459-bc4b023c358d on hv-cinder-85752 Sep 14 01:18:15.702835 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-c1e07c72-447a-499f-a922-c0e2fee8d2c7 req-27dcedf5-82b4-4406-92c5-c0579495d8f2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044899 Sep 14 01:18:15.703752 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 556/1119] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:18:16.410903 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-b5027ad6-71cd-4eb8-995e-629c3a708c02 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:16.411640 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-b5027ad6-71cd-4eb8-995e-629c3a708c02 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:16.428229 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b5027ad6-71cd-4eb8-995e-629c3a708c02 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:16.428739 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b5027ad6-71cd-4eb8-995e-629c3a708c02 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:16.429180 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b5027ad6-71cd-4eb8-995e-629c3a708c02 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:16.429906 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b5027ad6-71cd-4eb8-995e-629c3a708c02 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:16.430356 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b5027ad6-71cd-4eb8-995e-629c3a708c02 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:16.430800 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b5027ad6-71cd-4eb8-995e-629c3a708c02 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:16.576656 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b5027ad6-71cd-4eb8-995e-629c3a708c02 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:16.584819 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-b5027ad6-71cd-4eb8-995e-629c3a708c02 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1261 microversion: 2.1 time: 0.179820 Sep 14 01:18:16.585412 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 564/1120] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:16 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:17.525610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-b392b63a-cb7d-46a3-827e-d20cdf011642 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1775290525", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-787735033", "security_groups": [{"name": "tempest-secgroup-smoke-166959226"}], "block_device_mapping_v2": [{"uuid": "d2c03139-0b4c-4fc7-a81b-39aa744ab24c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cef33139-f42c-4679-8281-e97f735186d9"}]}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:18:17.608750 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-fa028829-1389-4604-88da-0f3c25a15f4d tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:17.609368 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-fa028829-1389-4604-88da-0f3c25a15f4d tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:17.615873 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa028829-1389-4604-88da-0f3c25a15f4d tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:17.616396 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa028829-1389-4604-88da-0f3c25a15f4d tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:17.616832 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa028829-1389-4604-88da-0f3c25a15f4d tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:17.617528 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa028829-1389-4604-88da-0f3c25a15f4d tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:17.617985 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa028829-1389-4604-88da-0f3c25a15f4d tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:17.618429 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-fa028829-1389-4604-88da-0f3c25a15f4d tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:17.640072 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-b392b63a-cb7d-46a3-827e-d20cdf011642 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] validate_networks() for [('cef33139-f42c-4679-8281-e97f735186d9', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:18:17.752976 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-fa028829-1389-4604-88da-0f3c25a15f4d tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:17.762259 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-fa028829-1389-4604-88da-0f3c25a15f4d tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1261 microversion: 2.1 time: 0.155982 Sep 14 01:18:17.762838 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 565/1121] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:17 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:18:18.008060 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-b392b63a-cb7d-46a3-827e-d20cdf011642 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:18:18.008480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-b392b63a-cb7d-46a3-827e-d20cdf011642 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:18:18.008951 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-b392b63a-cb7d-46a3-827e-d20cdf011642 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:18:18.009856 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-b392b63a-cb7d-46a3-827e-d20cdf011642 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:18:18.010302 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-b392b63a-cb7d-46a3-827e-d20cdf011642 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:18:18.019697 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b392b63a-cb7d-46a3-827e-d20cdf011642 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:18.020176 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b392b63a-cb7d-46a3-827e-d20cdf011642 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:18.020604 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b392b63a-cb7d-46a3-827e-d20cdf011642 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:18.021326 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b392b63a-cb7d-46a3-827e-d20cdf011642 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:18.021776 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b392b63a-cb7d-46a3-827e-d20cdf011642 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:18.022197 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-b392b63a-cb7d-46a3-827e-d20cdf011642 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:18.039135 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-b392b63a-cb7d-46a3-827e-d20cdf011642 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Getting quotas for project 6c0d5a6539764b53852b5741347734a8. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:18:18.043232 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-b392b63a-cb7d-46a3-827e-d20cdf011642 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Getting quotas for user b1494511685b47519f4aa0674009fbfc and project 6c0d5a6539764b53852b5741347734a8. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:18:18.102879 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b392b63a-cb7d-46a3-827e-d20cdf011642 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:18:18.105537 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-b392b63a-cb7d-46a3-827e-d20cdf011642 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d2c03139-0b4c-4fc7-a81b-39aa744ab24c',volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:18:18.234768 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-b392b63a-cb7d-46a3-827e-d20cdf011642 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.714348 Sep 14 01:18:18.235647 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 557/1122] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 01:18:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 01:18:18.247047 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-589337a9-0d60-4289-8431-0a43326ee3b4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:18.247697 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-589337a9-0d60-4289-8431-0a43326ee3b4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:18.301261 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-589337a9-0d60-4289-8431-0a43326ee3b4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:18.309057 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-589337a9-0d60-4289-8431-0a43326ee3b4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1094 microversion: 2.1 time: 0.066325 Sep 14 01:18:18.309626 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 566/1123] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:18 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:18.785862 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-bcbe8b0c-431b-41ab-8b86-bc2c3ad5a947 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:18.786471 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-bcbe8b0c-431b-41ab-8b86-bc2c3ad5a947 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:18.793756 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bcbe8b0c-431b-41ab-8b86-bc2c3ad5a947 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:18.794231 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bcbe8b0c-431b-41ab-8b86-bc2c3ad5a947 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:18.794661 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bcbe8b0c-431b-41ab-8b86-bc2c3ad5a947 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:18.795343 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bcbe8b0c-431b-41ab-8b86-bc2c3ad5a947 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:18.795818 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bcbe8b0c-431b-41ab-8b86-bc2c3ad5a947 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:18.796242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bcbe8b0c-431b-41ab-8b86-bc2c3ad5a947 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:18.932960 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-bcbe8b0c-431b-41ab-8b86-bc2c3ad5a947 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:18.940698 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-bcbe8b0c-431b-41ab-8b86-bc2c3ad5a947 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1261 microversion: 2.1 time: 0.159102 Sep 14 01:18:18.941392 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 558/1124] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:18 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:19.332392 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8b5c4429-4871-48fb-b10f-fe90ecd6a7b0 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:19.333630 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8b5c4429-4871-48fb-b10f-fe90ecd6a7b0 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:19.340549 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8b5c4429-4871-48fb-b10f-fe90ecd6a7b0 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:19.341294 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8b5c4429-4871-48fb-b10f-fe90ecd6a7b0 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:19.341960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8b5c4429-4871-48fb-b10f-fe90ecd6a7b0 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:19.342670 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8b5c4429-4871-48fb-b10f-fe90ecd6a7b0 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:19.343128 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8b5c4429-4871-48fb-b10f-fe90ecd6a7b0 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:19.343779 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8b5c4429-4871-48fb-b10f-fe90ecd6a7b0 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:19.412723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8b5c4429-4871-48fb-b10f-fe90ecd6a7b0 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:19.421285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8b5c4429-4871-48fb-b10f-fe90ecd6a7b0 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1200 microversion: 2.1 time: 0.092803 Sep 14 01:18:19.422105 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 567/1125] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:19 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1200 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:18:19.965056 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e7c6d4ee-76c4-418b-81dc-7df5ed47ea85 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:19.965762 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e7c6d4ee-76c4-418b-81dc-7df5ed47ea85 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:19.977142 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7c6d4ee-76c4-418b-81dc-7df5ed47ea85 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:19.977510 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7c6d4ee-76c4-418b-81dc-7df5ed47ea85 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:19.978935 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7c6d4ee-76c4-418b-81dc-7df5ed47ea85 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:19.985810 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7c6d4ee-76c4-418b-81dc-7df5ed47ea85 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:19.986681 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7c6d4ee-76c4-418b-81dc-7df5ed47ea85 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:19.988002 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e7c6d4ee-76c4-418b-81dc-7df5ed47ea85 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:20.444240 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-85471648-00f9-453c-b3ad-41cb4f239890 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:20.445192 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-85471648-00f9-453c-b3ad-41cb4f239890 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:20.452258 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-85471648-00f9-453c-b3ad-41cb4f239890 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:20.452743 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-85471648-00f9-453c-b3ad-41cb4f239890 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:20.453175 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-85471648-00f9-453c-b3ad-41cb4f239890 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:20.453990 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-85471648-00f9-453c-b3ad-41cb4f239890 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:20.454554 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-85471648-00f9-453c-b3ad-41cb4f239890 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:20.454904 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-85471648-00f9-453c-b3ad-41cb4f239890 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:20.461212 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e7c6d4ee-76c4-418b-81dc-7df5ed47ea85 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:20.469749 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e7c6d4ee-76c4-418b-81dc-7df5ed47ea85 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1261 microversion: 2.1 time: 0.509156 Sep 14 01:18:20.470553 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 559/1126] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:19 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1261 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:20.592706 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-85471648-00f9-453c-b3ad-41cb4f239890 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:20.600355 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-85471648-00f9-453c-b3ad-41cb4f239890 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1265 microversion: 2.1 time: 0.160057 Sep 14 01:18:20.600923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 568/1127] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:20 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:18:21.033265 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-ca485534-f0d3-488f-b2fc-3cae01d1f8b2 req-0f45aef1-cf6c-42b5-a53f-500186d50634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b27979fc-e36a-4644-9d51-55c6c105c7a9", "tag": "8c4592ba-3360-4783-a771-de0148eeab61"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:18:21.045449 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-ca485534-f0d3-488f-b2fc-3cae01d1f8b2 req-0f45aef1-cf6c-42b5-a53f-500186d50634 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:21.045997 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-ca485534-f0d3-488f-b2fc-3cae01d1f8b2 req-0f45aef1-cf6c-42b5-a53f-500186d50634 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:21.046501 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-ca485534-f0d3-488f-b2fc-3cae01d1f8b2 req-0f45aef1-cf6c-42b5-a53f-500186d50634 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:21.059399 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-ca485534-f0d3-488f-b2fc-3cae01d1f8b2 req-0f45aef1-cf6c-42b5-a53f-500186d50634 service nova] Creating event network-changed:8c4592ba-3360-4783-a771-de0148eeab61 for instance b27979fc-e36a-4644-9d51-55c6c105c7a9 on hv-cinder-85752 Sep 14 01:18:21.064432 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-ca485534-f0d3-488f-b2fc-3cae01d1f8b2 req-0f45aef1-cf6c-42b5-a53f-500186d50634 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034940 Sep 14 01:18:21.065099 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 560/1128] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:18:21.495762 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d7e90ed4-9515-4608-ace0-259c5f8be542 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:21.496321 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d7e90ed4-9515-4608-ace0-259c5f8be542 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:21.502860 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d7e90ed4-9515-4608-ace0-259c5f8be542 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:21.503360 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d7e90ed4-9515-4608-ace0-259c5f8be542 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:21.503904 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d7e90ed4-9515-4608-ace0-259c5f8be542 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:21.504605 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d7e90ed4-9515-4608-ace0-259c5f8be542 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:21.505107 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d7e90ed4-9515-4608-ace0-259c5f8be542 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:21.505613 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d7e90ed4-9515-4608-ace0-259c5f8be542 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:21.624144 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-da28406a-eaf7-4e57-94c9-2f1598c013f5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:21.624844 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-da28406a-eaf7-4e57-94c9-2f1598c013f5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:21.630862 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-da28406a-eaf7-4e57-94c9-2f1598c013f5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:21.631346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-da28406a-eaf7-4e57-94c9-2f1598c013f5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:21.631807 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-da28406a-eaf7-4e57-94c9-2f1598c013f5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:21.632500 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-da28406a-eaf7-4e57-94c9-2f1598c013f5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:21.632955 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-da28406a-eaf7-4e57-94c9-2f1598c013f5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:21.633379 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-da28406a-eaf7-4e57-94c9-2f1598c013f5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:21.640958 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d7e90ed4-9515-4608-ace0-259c5f8be542 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:21.648473 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d7e90ed4-9515-4608-ace0-259c5f8be542 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1261 microversion: 2.1 time: 0.158448 Sep 14 01:18:21.649036 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 569/1129] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:21 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:21.769480 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-da28406a-eaf7-4e57-94c9-2f1598c013f5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:21.777886 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-da28406a-eaf7-4e57-94c9-2f1598c013f5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1265 microversion: 2.1 time: 0.158847 Sep 14 01:18:21.778451 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 561/1130] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:21 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:18:22.671418 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-b95f8263-6c24-4068-9bfb-f3d44c430885 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:22.672076 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-b95f8263-6c24-4068-9bfb-f3d44c430885 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:22.678447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b95f8263-6c24-4068-9bfb-f3d44c430885 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:22.678930 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b95f8263-6c24-4068-9bfb-f3d44c430885 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:22.679369 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b95f8263-6c24-4068-9bfb-f3d44c430885 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:22.680092 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b95f8263-6c24-4068-9bfb-f3d44c430885 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:22.680599 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b95f8263-6c24-4068-9bfb-f3d44c430885 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:22.680981 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b95f8263-6c24-4068-9bfb-f3d44c430885 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:22.800592 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-43a18bfc-f385-4dba-abd4-e7ddfe111e97 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:22.801307 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-43a18bfc-f385-4dba-abd4-e7ddfe111e97 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:22.807921 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-43a18bfc-f385-4dba-abd4-e7ddfe111e97 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:22.808405 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-43a18bfc-f385-4dba-abd4-e7ddfe111e97 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:22.808838 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-43a18bfc-f385-4dba-abd4-e7ddfe111e97 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:22.809334 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b95f8263-6c24-4068-9bfb-f3d44c430885 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:22.809534 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-43a18bfc-f385-4dba-abd4-e7ddfe111e97 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:22.809991 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-43a18bfc-f385-4dba-abd4-e7ddfe111e97 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:22.810419 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-43a18bfc-f385-4dba-abd4-e7ddfe111e97 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:22.817390 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-b95f8263-6c24-4068-9bfb-f3d44c430885 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1261 microversion: 2.1 time: 0.149838 Sep 14 01:18:22.817967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 570/1131] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:22 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:22.940520 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-43a18bfc-f385-4dba-abd4-e7ddfe111e97 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:22.948420 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-43a18bfc-f385-4dba-abd4-e7ddfe111e97 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1265 microversion: 2.1 time: 0.151735 Sep 14 01:18:22.948980 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 562/1132] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:22 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:18:23.840357 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-259ec828-7187-47aa-86ae-1b8523037477 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:23.840975 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-259ec828-7187-47aa-86ae-1b8523037477 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:23.847370 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-259ec828-7187-47aa-86ae-1b8523037477 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:23.847909 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-259ec828-7187-47aa-86ae-1b8523037477 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:23.848348 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-259ec828-7187-47aa-86ae-1b8523037477 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:23.849037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-259ec828-7187-47aa-86ae-1b8523037477 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:23.849494 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-259ec828-7187-47aa-86ae-1b8523037477 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:23.849918 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-259ec828-7187-47aa-86ae-1b8523037477 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:23.971574 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-cd54c3c4-5aba-45fa-97ee-935d7dd1b6cb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:23.972202 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-cd54c3c4-5aba-45fa-97ee-935d7dd1b6cb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:23.979432 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cd54c3c4-5aba-45fa-97ee-935d7dd1b6cb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:23.979965 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cd54c3c4-5aba-45fa-97ee-935d7dd1b6cb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:23.980422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cd54c3c4-5aba-45fa-97ee-935d7dd1b6cb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:23.981107 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cd54c3c4-5aba-45fa-97ee-935d7dd1b6cb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:23.981558 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cd54c3c4-5aba-45fa-97ee-935d7dd1b6cb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:23.981980 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-cd54c3c4-5aba-45fa-97ee-935d7dd1b6cb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:23.985660 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-259ec828-7187-47aa-86ae-1b8523037477 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:23.993305 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-259ec828-7187-47aa-86ae-1b8523037477 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1261 microversion: 2.1 time: 0.156917 Sep 14 01:18:23.994700 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 571/1133] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:23 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:24.112118 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-cd54c3c4-5aba-45fa-97ee-935d7dd1b6cb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:24.120314 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-cd54c3c4-5aba-45fa-97ee-935d7dd1b6cb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1265 microversion: 2.1 time: 0.152660 Sep 14 01:18:24.120879 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 563/1134] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:23 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:18:25.016458 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ba08f4d7-5a47-484e-b1e8-5d14414b8f78 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:25.017046 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ba08f4d7-5a47-484e-b1e8-5d14414b8f78 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:25.023372 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba08f4d7-5a47-484e-b1e8-5d14414b8f78 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:25.023880 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba08f4d7-5a47-484e-b1e8-5d14414b8f78 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:25.024312 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba08f4d7-5a47-484e-b1e8-5d14414b8f78 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:25.025047 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba08f4d7-5a47-484e-b1e8-5d14414b8f78 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:25.025556 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba08f4d7-5a47-484e-b1e8-5d14414b8f78 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:25.025951 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ba08f4d7-5a47-484e-b1e8-5d14414b8f78 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:25.142489 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-37f3b6ba-7a0e-4ba8-8030-11f2613f96e6 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:25.143104 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-37f3b6ba-7a0e-4ba8-8030-11f2613f96e6 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:25.149437 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-37f3b6ba-7a0e-4ba8-8030-11f2613f96e6 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:25.149965 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-37f3b6ba-7a0e-4ba8-8030-11f2613f96e6 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:25.150406 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-37f3b6ba-7a0e-4ba8-8030-11f2613f96e6 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:25.151109 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-37f3b6ba-7a0e-4ba8-8030-11f2613f96e6 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:25.151577 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-37f3b6ba-7a0e-4ba8-8030-11f2613f96e6 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:25.152020 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-37f3b6ba-7a0e-4ba8-8030-11f2613f96e6 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:25.154123 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-ba08f4d7-5a47-484e-b1e8-5d14414b8f78 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:25.161855 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ba08f4d7-5a47-484e-b1e8-5d14414b8f78 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1261 microversion: 2.1 time: 0.149236 Sep 14 01:18:25.162413 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 572/1135] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:25 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:25.286335 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-37f3b6ba-7a0e-4ba8-8030-11f2613f96e6 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:25.293992 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-37f3b6ba-7a0e-4ba8-8030-11f2613f96e6 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1265 microversion: 2.1 time: 0.155424 Sep 14 01:18:25.294632 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 564/1136] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:25 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:18:26.184918 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-b957e8d0-0862-44f5-bc08-8c7948bbb735 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:26.185571 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-b957e8d0-0862-44f5-bc08-8c7948bbb735 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:26.191985 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b957e8d0-0862-44f5-bc08-8c7948bbb735 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:26.192465 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b957e8d0-0862-44f5-bc08-8c7948bbb735 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:26.192894 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b957e8d0-0862-44f5-bc08-8c7948bbb735 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:26.193574 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b957e8d0-0862-44f5-bc08-8c7948bbb735 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:26.194023 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b957e8d0-0862-44f5-bc08-8c7948bbb735 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:26.194440 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-b957e8d0-0862-44f5-bc08-8c7948bbb735 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:26.317457 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a99c4ce2-5a31-416a-809e-30c0849a2e0b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:26.318056 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a99c4ce2-5a31-416a-809e-30c0849a2e0b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:26.325210 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a99c4ce2-5a31-416a-809e-30c0849a2e0b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:26.326020 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a99c4ce2-5a31-416a-809e-30c0849a2e0b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:26.326465 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a99c4ce2-5a31-416a-809e-30c0849a2e0b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:26.327169 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a99c4ce2-5a31-416a-809e-30c0849a2e0b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:26.327660 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a99c4ce2-5a31-416a-809e-30c0849a2e0b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:26.328160 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a99c4ce2-5a31-416a-809e-30c0849a2e0b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:26.331067 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-b957e8d0-0862-44f5-bc08-8c7948bbb735 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:26.339648 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-b957e8d0-0862-44f5-bc08-8c7948bbb735 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1261 microversion: 2.1 time: 0.158514 Sep 14 01:18:26.340182 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 573/1137] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:26 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:26.460584 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a99c4ce2-5a31-416a-809e-30c0849a2e0b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:26.468765 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a99c4ce2-5a31-416a-809e-30c0849a2e0b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1265 microversion: 2.1 time: 0.155163 Sep 14 01:18:26.469632 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 565/1138] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:26 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:18:27.362226 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0d236d13-c26b-4dfb-88bd-04b96ca0b99f tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:27.362816 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0d236d13-c26b-4dfb-88bd-04b96ca0b99f tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:27.369352 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0d236d13-c26b-4dfb-88bd-04b96ca0b99f tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:27.369829 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0d236d13-c26b-4dfb-88bd-04b96ca0b99f tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:27.370264 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0d236d13-c26b-4dfb-88bd-04b96ca0b99f tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:27.370951 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0d236d13-c26b-4dfb-88bd-04b96ca0b99f tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:27.371402 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0d236d13-c26b-4dfb-88bd-04b96ca0b99f tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:27.371850 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0d236d13-c26b-4dfb-88bd-04b96ca0b99f tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:27.491805 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-1d6973f1-50ec-4f90-9aea-5195ad6a95d1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:27.492446 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-1d6973f1-50ec-4f90-9aea-5195ad6a95d1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:27.498882 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1d6973f1-50ec-4f90-9aea-5195ad6a95d1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:27.499372 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1d6973f1-50ec-4f90-9aea-5195ad6a95d1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:27.499840 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1d6973f1-50ec-4f90-9aea-5195ad6a95d1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:27.500537 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1d6973f1-50ec-4f90-9aea-5195ad6a95d1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:27.500997 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1d6973f1-50ec-4f90-9aea-5195ad6a95d1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:27.501136 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0d236d13-c26b-4dfb-88bd-04b96ca0b99f tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:27.501423 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-1d6973f1-50ec-4f90-9aea-5195ad6a95d1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:27.508854 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0d236d13-c26b-4dfb-88bd-04b96ca0b99f tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1261 microversion: 2.1 time: 0.150336 Sep 14 01:18:27.509737 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 574/1139] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:27 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:27.635849 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-1d6973f1-50ec-4f90-9aea-5195ad6a95d1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:27.643688 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-1d6973f1-50ec-4f90-9aea-5195ad6a95d1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1265 microversion: 2.1 time: 0.155828 Sep 14 01:18:27.644248 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 566/1140] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:27 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:18:28.118732 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-7f617d88-641d-4b5b-b6a7-b1ac18fe0f72 req-c03fa326-384f-4bf3-9091-e8356a3177cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5047389f-d232-432f-a459-bc4b023c358d", "name": "network-vif-plugged", "status": "completed", "tag": "95cbc616-90a4-4fe0-8288-92d9ab2f32b3"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:18:28.128907 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-7f617d88-641d-4b5b-b6a7-b1ac18fe0f72 req-c03fa326-384f-4bf3-9091-e8356a3177cc service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:28.129403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-7f617d88-641d-4b5b-b6a7-b1ac18fe0f72 req-c03fa326-384f-4bf3-9091-e8356a3177cc service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:28.129823 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-7f617d88-641d-4b5b-b6a7-b1ac18fe0f72 req-c03fa326-384f-4bf3-9091-e8356a3177cc service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:28.140919 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-7f617d88-641d-4b5b-b6a7-b1ac18fe0f72 req-c03fa326-384f-4bf3-9091-e8356a3177cc service nova] Creating event network-vif-plugged:95cbc616-90a4-4fe0-8288-92d9ab2f32b3 for instance 5047389f-d232-432f-a459-bc4b023c358d on hv-cinder-85752 Sep 14 01:18:28.145907 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-7f617d88-641d-4b5b-b6a7-b1ac18fe0f72 req-c03fa326-384f-4bf3-9091-e8356a3177cc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150038 Sep 14 01:18:28.146486 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 575/1141] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:18:28.532187 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-905f4e00-6e1f-42b4-be85-5b1bc793c1fd tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:28.532801 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-905f4e00-6e1f-42b4-be85-5b1bc793c1fd tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:28.534715 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=4 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:18:28.535372 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=12 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:18:28.542356 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-905f4e00-6e1f-42b4-be85-5b1bc793c1fd tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:28.542840 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-905f4e00-6e1f-42b4-be85-5b1bc793c1fd tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:28.543275 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-905f4e00-6e1f-42b4-be85-5b1bc793c1fd tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:28.544116 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-905f4e00-6e1f-42b4-be85-5b1bc793c1fd tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:28.544576 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-905f4e00-6e1f-42b4-be85-5b1bc793c1fd tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:28.544999 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-905f4e00-6e1f-42b4-be85-5b1bc793c1fd tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:28.663483 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=4 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:18:28.668425 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d3fa0cb1-9d72-44b5-ba05-3d27a62dc5eb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:28.669126 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d3fa0cb1-9d72-44b5-ba05-3d27a62dc5eb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:28.676720 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-905f4e00-6e1f-42b4-be85-5b1bc793c1fd tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:28.680474 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d3fa0cb1-9d72-44b5-ba05-3d27a62dc5eb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:28.682246 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d3fa0cb1-9d72-44b5-ba05-3d27a62dc5eb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:28.682790 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d3fa0cb1-9d72-44b5-ba05-3d27a62dc5eb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:28.683514 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d3fa0cb1-9d72-44b5-ba05-3d27a62dc5eb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:28.684003 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d3fa0cb1-9d72-44b5-ba05-3d27a62dc5eb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:28.684457 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d3fa0cb1-9d72-44b5-ba05-3d27a62dc5eb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:28.686338 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-905f4e00-6e1f-42b4-be85-5b1bc793c1fd tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1261 microversion: 2.1 time: 0.157983 Sep 14 01:18:28.686906 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 567/1142] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:28 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:28.816527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d3fa0cb1-9d72-44b5-ba05-3d27a62dc5eb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:28.825049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d3fa0cb1-9d72-44b5-ba05-3d27a62dc5eb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1265 microversion: 2.1 time: 0.162448 Sep 14 01:18:28.825614 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 576/1143] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:28 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:18:29.709308 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ee4d27c9-266c-46e8-9369-a798ec9e61ec tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:29.709923 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ee4d27c9-266c-46e8-9369-a798ec9e61ec tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:29.717433 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ee4d27c9-266c-46e8-9369-a798ec9e61ec tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:29.717951 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ee4d27c9-266c-46e8-9369-a798ec9e61ec tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:29.718402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ee4d27c9-266c-46e8-9369-a798ec9e61ec tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:29.719079 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ee4d27c9-266c-46e8-9369-a798ec9e61ec tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:29.719536 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ee4d27c9-266c-46e8-9369-a798ec9e61ec tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:29.719988 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ee4d27c9-266c-46e8-9369-a798ec9e61ec tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:29.846397 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-dbfb811e-2941-4441-a6f9-2950d2958bf5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:29.847148 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-dbfb811e-2941-4441-a6f9-2950d2958bf5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:29.853623 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ee4d27c9-266c-46e8-9369-a798ec9e61ec tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:29.853802 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-dbfb811e-2941-4441-a6f9-2950d2958bf5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:29.854230 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-dbfb811e-2941-4441-a6f9-2950d2958bf5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:29.854667 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-dbfb811e-2941-4441-a6f9-2950d2958bf5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:29.855371 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-dbfb811e-2941-4441-a6f9-2950d2958bf5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:29.856386 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-dbfb811e-2941-4441-a6f9-2950d2958bf5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:29.858015 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-dbfb811e-2941-4441-a6f9-2950d2958bf5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:29.861917 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ee4d27c9-266c-46e8-9369-a798ec9e61ec tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1261 microversion: 2.1 time: 0.156512 Sep 14 01:18:29.862479 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 568/1144] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:29 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:29.990034 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-dbfb811e-2941-4441-a6f9-2950d2958bf5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:29.997791 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-dbfb811e-2941-4441-a6f9-2950d2958bf5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1265 microversion: 2.1 time: 0.155309 Sep 14 01:18:29.998355 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 577/1145] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:29 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:18:30.884501 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a834b1b6-b850-409d-8e68-6b6f0da4d25b tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:30.885257 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a834b1b6-b850-409d-8e68-6b6f0da4d25b tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:30.891877 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a834b1b6-b850-409d-8e68-6b6f0da4d25b tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:30.892354 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a834b1b6-b850-409d-8e68-6b6f0da4d25b tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:30.892783 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a834b1b6-b850-409d-8e68-6b6f0da4d25b tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:30.893461 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a834b1b6-b850-409d-8e68-6b6f0da4d25b tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:30.893915 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a834b1b6-b850-409d-8e68-6b6f0da4d25b tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:30.894330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a834b1b6-b850-409d-8e68-6b6f0da4d25b tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:31.020975 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-c3bb981a-9037-4fbb-a388-222b96e642fb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:31.021683 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-c3bb981a-9037-4fbb-a388-222b96e642fb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:31.026616 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a834b1b6-b850-409d-8e68-6b6f0da4d25b tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:31.028531 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c3bb981a-9037-4fbb-a388-222b96e642fb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:31.029019 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c3bb981a-9037-4fbb-a388-222b96e642fb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:31.029458 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c3bb981a-9037-4fbb-a388-222b96e642fb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:31.030156 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c3bb981a-9037-4fbb-a388-222b96e642fb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:31.030617 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c3bb981a-9037-4fbb-a388-222b96e642fb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:31.031039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c3bb981a-9037-4fbb-a388-222b96e642fb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:31.034252 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a834b1b6-b850-409d-8e68-6b6f0da4d25b tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1261 microversion: 2.1 time: 0.153873 Sep 14 01:18:31.035033 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 569/1146] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:30 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:31.171115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c3bb981a-9037-4fbb-a388-222b96e642fb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:31.178667 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-c3bb981a-9037-4fbb-a388-222b96e642fb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1265 microversion: 2.1 time: 0.161630 Sep 14 01:18:31.179223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 578/1147] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:31 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:18:32.057107 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-d798e1bc-4e3f-4454-88a4-315362f9187e tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:32.057721 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-d798e1bc-4e3f-4454-88a4-315362f9187e tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:32.064162 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d798e1bc-4e3f-4454-88a4-315362f9187e tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:32.064649 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d798e1bc-4e3f-4454-88a4-315362f9187e tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:32.065085 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d798e1bc-4e3f-4454-88a4-315362f9187e tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:32.065769 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d798e1bc-4e3f-4454-88a4-315362f9187e tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:32.066224 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d798e1bc-4e3f-4454-88a4-315362f9187e tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:32.066646 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-d798e1bc-4e3f-4454-88a4-315362f9187e tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:32.201751 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-425791b4-409e-4ac9-9efe-3beda45882bd tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:32.202250 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-d798e1bc-4e3f-4454-88a4-315362f9187e tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:32.203039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-425791b4-409e-4ac9-9efe-3beda45882bd tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:32.209336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-425791b4-409e-4ac9-9efe-3beda45882bd tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:32.209814 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-425791b4-409e-4ac9-9efe-3beda45882bd tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:32.210074 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-d798e1bc-4e3f-4454-88a4-315362f9187e tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1445 microversion: 2.1 time: 0.157358 Sep 14 01:18:32.210246 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-425791b4-409e-4ac9-9efe-3beda45882bd tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:32.210632 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 570/1148] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:32 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:32.210931 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-425791b4-409e-4ac9-9efe-3beda45882bd tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:32.211450 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-425791b4-409e-4ac9-9efe-3beda45882bd tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:32.211899 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-425791b4-409e-4ac9-9efe-3beda45882bd tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:32.232478 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-4b8dfbe3-822c-44d1-bb85-9f96b1b18ceb tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:32.233080 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-4b8dfbe3-822c-44d1-bb85-9f96b1b18ceb tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:32.238815 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b8dfbe3-822c-44d1-bb85-9f96b1b18ceb tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:32.239290 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b8dfbe3-822c-44d1-bb85-9f96b1b18ceb tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:32.239789 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b8dfbe3-822c-44d1-bb85-9f96b1b18ceb tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:32.240470 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b8dfbe3-822c-44d1-bb85-9f96b1b18ceb tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:32.240983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b8dfbe3-822c-44d1-bb85-9f96b1b18ceb tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:32.241416 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-4b8dfbe3-822c-44d1-bb85-9f96b1b18ceb tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:32.347586 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-425791b4-409e-4ac9-9efe-3beda45882bd tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:32.355886 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-425791b4-409e-4ac9-9efe-3beda45882bd tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1265 microversion: 2.1 time: 0.158502 Sep 14 01:18:32.356457 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 579/1149] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:32 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:18:32.384747 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-4b8dfbe3-822c-44d1-bb85-9f96b1b18ceb tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:32.392710 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-4b8dfbe3-822c-44d1-bb85-9f96b1b18ceb tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1445 microversion: 2.1 time: 0.164770 Sep 14 01:18:32.393272 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 571/1150] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:32 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1445 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:18:33.378492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-aebaa305-da4e-4a5e-b2cf-b583bbcbb408 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:33.379783 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-aebaa305-da4e-4a5e-b2cf-b583bbcbb408 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:33.386858 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aebaa305-da4e-4a5e-b2cf-b583bbcbb408 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:33.387342 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aebaa305-da4e-4a5e-b2cf-b583bbcbb408 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:33.387808 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aebaa305-da4e-4a5e-b2cf-b583bbcbb408 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:33.388513 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aebaa305-da4e-4a5e-b2cf-b583bbcbb408 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:33.388967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aebaa305-da4e-4a5e-b2cf-b583bbcbb408 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:33.389393 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-aebaa305-da4e-4a5e-b2cf-b583bbcbb408 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:33.521879 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-aebaa305-da4e-4a5e-b2cf-b583bbcbb408 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:33.530452 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-aebaa305-da4e-4a5e-b2cf-b583bbcbb408 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1265 microversion: 2.1 time: 0.156066 Sep 14 01:18:33.531016 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 580/1151] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:33 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:34.050707 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-eed43ede-b5ca-4537-9a76-4fc6e3d9f96d req-92671a94-8a2b-4830-bb89-68979be8200f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27979fc-e36a-4644-9d51-55c6c105c7a9", "name": "network-vif-plugged", "status": "completed", "tag": "8c4592ba-3360-4783-a771-de0148eeab61"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:18:34.061210 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-eed43ede-b5ca-4537-9a76-4fc6e3d9f96d req-92671a94-8a2b-4830-bb89-68979be8200f service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:34.061751 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-eed43ede-b5ca-4537-9a76-4fc6e3d9f96d req-92671a94-8a2b-4830-bb89-68979be8200f service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:34.062205 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-eed43ede-b5ca-4537-9a76-4fc6e3d9f96d req-92671a94-8a2b-4830-bb89-68979be8200f service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:34.074629 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-eed43ede-b5ca-4537-9a76-4fc6e3d9f96d req-92671a94-8a2b-4830-bb89-68979be8200f service nova] Creating event network-vif-plugged:8c4592ba-3360-4783-a771-de0148eeab61 for instance b27979fc-e36a-4644-9d51-55c6c105c7a9 on hv-cinder-85752 Sep 14 01:18:34.080536 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-eed43ede-b5ca-4537-9a76-4fc6e3d9f96d req-92671a94-8a2b-4830-bb89-68979be8200f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033990 Sep 14 01:18:34.081624 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 572/1152] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:18:34.154478 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-13deb659-6218-4dd8-86e8-72430f8ebe9b req-e4a87154-6cd5-47de-8590-e66aa6e44673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5047389f-d232-432f-a459-bc4b023c358d", "tag": "95cbc616-90a4-4fe0-8288-92d9ab2f32b3"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:18:34.163817 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-13deb659-6218-4dd8-86e8-72430f8ebe9b req-e4a87154-6cd5-47de-8590-e66aa6e44673 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:34.164301 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-13deb659-6218-4dd8-86e8-72430f8ebe9b req-e4a87154-6cd5-47de-8590-e66aa6e44673 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:34.164736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-13deb659-6218-4dd8-86e8-72430f8ebe9b req-e4a87154-6cd5-47de-8590-e66aa6e44673 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:34.168894 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=100 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:18:34.176507 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-13deb659-6218-4dd8-86e8-72430f8ebe9b req-e4a87154-6cd5-47de-8590-e66aa6e44673 service nova] Creating event network-changed:95cbc616-90a4-4fe0-8288-92d9ab2f32b3 for instance 5047389f-d232-432f-a459-bc4b023c358d on hv-cinder-85752 Sep 14 01:18:34.182170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-13deb659-6218-4dd8-86e8-72430f8ebe9b req-e4a87154-6cd5-47de-8590-e66aa6e44673 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031901 Sep 14 01:18:34.182959 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 581/1153] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:18:34.553494 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-29687774-ee8b-480e-8a6a-b09d3b199fcc tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:34.554190 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-29687774-ee8b-480e-8a6a-b09d3b199fcc tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:34.561277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-29687774-ee8b-480e-8a6a-b09d3b199fcc tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:34.561766 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-29687774-ee8b-480e-8a6a-b09d3b199fcc tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:34.562204 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-29687774-ee8b-480e-8a6a-b09d3b199fcc tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:34.562899 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-29687774-ee8b-480e-8a6a-b09d3b199fcc tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:34.563353 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-29687774-ee8b-480e-8a6a-b09d3b199fcc tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:34.563805 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-29687774-ee8b-480e-8a6a-b09d3b199fcc tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:34.694901 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-29687774-ee8b-480e-8a6a-b09d3b199fcc tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:34.698836 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=100 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:18:34.703857 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-29687774-ee8b-480e-8a6a-b09d3b199fcc tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1265 microversion: 2.1 time: 0.154600 Sep 14 01:18:34.704424 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 573/1154] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:34 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:35.728326 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4cd6e76f-6e90-4af5-871f-920830138c93 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:35.729028 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4cd6e76f-6e90-4af5-871f-920830138c93 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:35.735002 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4cd6e76f-6e90-4af5-871f-920830138c93 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:35.735482 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4cd6e76f-6e90-4af5-871f-920830138c93 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:35.735952 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4cd6e76f-6e90-4af5-871f-920830138c93 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:35.736643 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4cd6e76f-6e90-4af5-871f-920830138c93 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:35.737087 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4cd6e76f-6e90-4af5-871f-920830138c93 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:35.737510 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4cd6e76f-6e90-4af5-871f-920830138c93 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:35.872039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4cd6e76f-6e90-4af5-871f-920830138c93 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:35.879796 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4cd6e76f-6e90-4af5-871f-920830138c93 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1451 microversion: 2.1 time: 0.156322 Sep 14 01:18:35.880361 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 582/1155] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:35 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:35.901618 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ab772087-3450-4e8c-bbfe-7276851e35f8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:18:35.902228 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ab772087-3450-4e8c-bbfe-7276851e35f8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:18:35.909165 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab772087-3450-4e8c-bbfe-7276851e35f8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:35.909652 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab772087-3450-4e8c-bbfe-7276851e35f8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:35.910088 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab772087-3450-4e8c-bbfe-7276851e35f8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:35.910780 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab772087-3450-4e8c-bbfe-7276851e35f8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:35.911242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab772087-3450-4e8c-bbfe-7276851e35f8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:35.911696 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ab772087-3450-4e8c-bbfe-7276851e35f8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:36.051853 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ab772087-3450-4e8c-bbfe-7276851e35f8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:18:36.060364 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ab772087-3450-4e8c-bbfe-7276851e35f8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1451 microversion: 2.1 time: 0.162604 Sep 14 01:18:36.060923 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 574/1156] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:18:35 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:18:38.012747 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-a2988f57-f20a-44a2-9fdc-a89066b5e9b3 req-ebf1f43d-189a-4cb9-b48f-832f752eb0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b27979fc-e36a-4644-9d51-55c6c105c7a9", "tag": "8c4592ba-3360-4783-a771-de0148eeab61"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:18:38.022160 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-a2988f57-f20a-44a2-9fdc-a89066b5e9b3 req-ebf1f43d-189a-4cb9-b48f-832f752eb0a5 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:18:38.022638 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-a2988f57-f20a-44a2-9fdc-a89066b5e9b3 req-ebf1f43d-189a-4cb9-b48f-832f752eb0a5 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:18:38.023065 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-a2988f57-f20a-44a2-9fdc-a89066b5e9b3 req-ebf1f43d-189a-4cb9-b48f-832f752eb0a5 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:18:38.034702 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-a2988f57-f20a-44a2-9fdc-a89066b5e9b3 req-ebf1f43d-189a-4cb9-b48f-832f752eb0a5 service nova] Creating event network-changed:8c4592ba-3360-4783-a771-de0148eeab61 for instance b27979fc-e36a-4644-9d51-55c6c105c7a9 on hv-cinder-85752 Sep 14 01:18:38.039871 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-a2988f57-f20a-44a2-9fdc-a89066b5e9b3 req-ebf1f43d-189a-4cb9-b48f-832f752eb0a5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086259 Sep 14 01:18:38.040814 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 583/1157] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:20:48.511630 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f306ce0-c037-4ea3-a880-2344cab43032] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 01:20:48.512513 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:20:48.513262 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=6 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:20:48.515140 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 01:20:48.515388 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Wed Sep 14 01:20:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d/action (ip 10.222.0.42) !!! Sep 14 01:20:48.517573 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 01:20:48.517702 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Wed Sep 14 01:20:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d/action (ip 10.222.0.42) !!! Sep 14 01:20:48.525090 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-963250c5-2023-40fd-9b32-d17807d42d17 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:20:48.525620 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-963250c5-2023-40fd-9b32-d17807d42d17 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:20:48.536262 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-963250c5-2023-40fd-9b32-d17807d42d17 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:48.536742 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-963250c5-2023-40fd-9b32-d17807d42d17 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:48.537176 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-963250c5-2023-40fd-9b32-d17807d42d17 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:48.537864 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-963250c5-2023-40fd-9b32-d17807d42d17 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:48.538317 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-963250c5-2023-40fd-9b32-d17807d42d17 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:48.538741 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-963250c5-2023-40fd-9b32-d17807d42d17 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:48.561689 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.objects.instance [None req-963250c5-2023-40fd-9b32-d17807d42d17 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lazy-loading 'flavor' on Instance uuid 5047389f-d232-432f-a459-bc4b023c358d {{(pid=120621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:20:48.633708 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-963250c5-2023-40fd-9b32-d17807d42d17 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "POST /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d/action" status: 202 len: 0 microversion: 2.1 time: 0.123635 Sep 14 01:20:48.634288 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 575/1158] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 01:20:48 2022] POST /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:20:48.641206 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a0fbe376-67c5-4697-b243-06802adaa4b9] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 01:20:48.642102 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=48 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:20:48.642867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=8 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:20:48.644785 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 01:20:48.644942 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Wed Sep 14 01:20:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d (ip 10.222.0.42) !!! Sep 14 01:20:48.646691 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 01:20:48.646845 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Wed Sep 14 01:20:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d (ip 10.222.0.42) !!! Sep 14 01:20:48.652402 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-778a9aff-cae1-4655-8c00-1ef4aa1f383a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:20:48.653142 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-778a9aff-cae1-4655-8c00-1ef4aa1f383a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:20:48.663095 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-778a9aff-cae1-4655-8c00-1ef4aa1f383a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:48.663600 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-778a9aff-cae1-4655-8c00-1ef4aa1f383a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:48.664039 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-778a9aff-cae1-4655-8c00-1ef4aa1f383a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:48.664732 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-778a9aff-cae1-4655-8c00-1ef4aa1f383a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:48.665178 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-778a9aff-cae1-4655-8c00-1ef4aa1f383a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:48.665595 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-778a9aff-cae1-4655-8c00-1ef4aa1f383a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:48.855528 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-778a9aff-cae1-4655-8c00-1ef4aa1f383a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:20:48.863586 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-778a9aff-cae1-4655-8c00-1ef4aa1f383a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1570 microversion: 2.1 time: 0.224295 Sep 14 01:20:48.864211 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 584/1159] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:20:48 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1570 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:20:49.890264 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9446d3bb-d64e-4c28-8e10-d4f0a1d65b17 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:20:49.890883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9446d3bb-d64e-4c28-8e10-d4f0a1d65b17 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:20:49.900397 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9446d3bb-d64e-4c28-8e10-d4f0a1d65b17 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:49.900880 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9446d3bb-d64e-4c28-8e10-d4f0a1d65b17 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:49.901319 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9446d3bb-d64e-4c28-8e10-d4f0a1d65b17 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:49.902013 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9446d3bb-d64e-4c28-8e10-d4f0a1d65b17 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:49.902467 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9446d3bb-d64e-4c28-8e10-d4f0a1d65b17 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:49.902893 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9446d3bb-d64e-4c28-8e10-d4f0a1d65b17 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:49.906548 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f306ce0-c037-4ea3-a880-2344cab43032] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 43344. Sep 14 01:20:50.088175 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9446d3bb-d64e-4c28-8e10-d4f0a1d65b17 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:20:50.095832 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9446d3bb-d64e-4c28-8e10-d4f0a1d65b17 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1570 microversion: 2.1 time: 0.212239 Sep 14 01:20:50.096399 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 576/1160] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:20:49 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1570 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:20:51.120210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2969ffcf-d526-4446-a31a-92f7f7ca5e31 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:20:51.120747 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2969ffcf-d526-4446-a31a-92f7f7ca5e31 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:20:51.127800 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2969ffcf-d526-4446-a31a-92f7f7ca5e31 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:51.128821 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2969ffcf-d526-4446-a31a-92f7f7ca5e31 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:51.129446 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2969ffcf-d526-4446-a31a-92f7f7ca5e31 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:51.130142 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2969ffcf-d526-4446-a31a-92f7f7ca5e31 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:51.130599 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2969ffcf-d526-4446-a31a-92f7f7ca5e31 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:51.131023 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2969ffcf-d526-4446-a31a-92f7f7ca5e31 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:51.137063 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO oslo.messaging._drivers.impl_rabbit [-] [a0fbe376-67c5-4697-b243-06802adaa4b9] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 43350. Sep 14 01:20:51.268622 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-2969ffcf-d526-4446-a31a-92f7f7ca5e31 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:20:51.277668 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2969ffcf-d526-4446-a31a-92f7f7ca5e31 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1570 microversion: 2.1 time: 0.161491 Sep 14 01:20:51.278231 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 585/1161] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:20:51 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:20:52.301605 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-51afbfb4-6428-47e3-a130-ea4819419ddc tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:20:52.302209 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-51afbfb4-6428-47e3-a130-ea4819419ddc tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:20:52.308499 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-51afbfb4-6428-47e3-a130-ea4819419ddc tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:52.308972 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-51afbfb4-6428-47e3-a130-ea4819419ddc tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:52.309402 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-51afbfb4-6428-47e3-a130-ea4819419ddc tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:52.310077 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-51afbfb4-6428-47e3-a130-ea4819419ddc tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:52.310526 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-51afbfb4-6428-47e3-a130-ea4819419ddc tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:52.310940 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-51afbfb4-6428-47e3-a130-ea4819419ddc tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:52.440242 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-51afbfb4-6428-47e3-a130-ea4819419ddc tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:20:52.448474 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-51afbfb4-6428-47e3-a130-ea4819419ddc tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1570 microversion: 2.1 time: 0.151220 Sep 14 01:20:52.449037 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 577/1162] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:20:52 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:20:53.168942 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2779dee1-4f65-4fbe-8ecf-df51670278e2 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:20:53.169516 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2779dee1-4f65-4fbe-8ecf-df51670278e2 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:20:53.176664 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2779dee1-4f65-4fbe-8ecf-df51670278e2 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:53.177143 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2779dee1-4f65-4fbe-8ecf-df51670278e2 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:53.177583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2779dee1-4f65-4fbe-8ecf-df51670278e2 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:53.178344 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2779dee1-4f65-4fbe-8ecf-df51670278e2 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:53.178886 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2779dee1-4f65-4fbe-8ecf-df51670278e2 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:53.179314 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2779dee1-4f65-4fbe-8ecf-df51670278e2 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:53.205843 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2779dee1-4f65-4fbe-8ecf-df51670278e2 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Going to try to terminate instance {{(pid=120620) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:20:53.279992 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2779dee1-4f65-4fbe-8ecf-df51670278e2 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 204 len: 0 microversion: 2.1 time: 0.114483 Sep 14 01:20:53.280768 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 586/1163] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:20:53 2022] DELETE /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 01:20:53.289786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-54d7eb33-807c-4fa2-b88b-3ab021e3cf46 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:20:53.290405 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-54d7eb33-807c-4fa2-b88b-3ab021e3cf46 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:20:53.296340 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54d7eb33-807c-4fa2-b88b-3ab021e3cf46 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:53.296825 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54d7eb33-807c-4fa2-b88b-3ab021e3cf46 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:53.297259 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54d7eb33-807c-4fa2-b88b-3ab021e3cf46 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:53.297947 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54d7eb33-807c-4fa2-b88b-3ab021e3cf46 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:53.298400 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54d7eb33-807c-4fa2-b88b-3ab021e3cf46 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:53.298825 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-54d7eb33-807c-4fa2-b88b-3ab021e3cf46 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:53.433616 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-54d7eb33-807c-4fa2-b88b-3ab021e3cf46 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:20:53.441494 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-54d7eb33-807c-4fa2-b88b-3ab021e3cf46 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1576 microversion: 2.1 time: 0.155539 Sep 14 01:20:53.442062 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 578/1164] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:20:53 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:20:53.473672 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-4f5deaba-489c-42d5-a788-473a25ddf083 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:20:53.474357 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-4f5deaba-489c-42d5-a788-473a25ddf083 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:20:53.480308 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4f5deaba-489c-42d5-a788-473a25ddf083 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:53.480795 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4f5deaba-489c-42d5-a788-473a25ddf083 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:53.481224 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4f5deaba-489c-42d5-a788-473a25ddf083 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:53.482180 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4f5deaba-489c-42d5-a788-473a25ddf083 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:53.482344 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4f5deaba-489c-42d5-a788-473a25ddf083 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:53.482760 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-4f5deaba-489c-42d5-a788-473a25ddf083 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:53.613249 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-4f5deaba-489c-42d5-a788-473a25ddf083 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:20:53.620924 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-4f5deaba-489c-42d5-a788-473a25ddf083 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1570 microversion: 2.1 time: 0.152129 Sep 14 01:20:53.621488 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 587/1165] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:20:53 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:20:54.464125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a92cba58-792b-4ced-a78e-6937531eaa6c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:20:54.464738 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a92cba58-792b-4ced-a78e-6937531eaa6c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:20:54.471111 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a92cba58-792b-4ced-a78e-6937531eaa6c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:54.471624 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a92cba58-792b-4ced-a78e-6937531eaa6c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:54.472488 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a92cba58-792b-4ced-a78e-6937531eaa6c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:54.473181 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a92cba58-792b-4ced-a78e-6937531eaa6c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:54.473639 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a92cba58-792b-4ced-a78e-6937531eaa6c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:54.474065 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a92cba58-792b-4ced-a78e-6937531eaa6c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:54.606641 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-a92cba58-792b-4ced-a78e-6937531eaa6c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:20:54.616320 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a92cba58-792b-4ced-a78e-6937531eaa6c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1576 microversion: 2.1 time: 0.155699 Sep 14 01:20:54.617341 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 579/1166] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:20:54 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:20:54.643945 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2ae02aa6-1872-4847-906c-39ca7f619fad tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:20:54.644658 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2ae02aa6-1872-4847-906c-39ca7f619fad tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:20:54.651047 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2ae02aa6-1872-4847-906c-39ca7f619fad tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:54.651530 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2ae02aa6-1872-4847-906c-39ca7f619fad tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:54.651994 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2ae02aa6-1872-4847-906c-39ca7f619fad tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:54.652678 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2ae02aa6-1872-4847-906c-39ca7f619fad tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:54.653132 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2ae02aa6-1872-4847-906c-39ca7f619fad tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:54.653554 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2ae02aa6-1872-4847-906c-39ca7f619fad tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:54.783151 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-2ae02aa6-1872-4847-906c-39ca7f619fad tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:20:54.791496 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2ae02aa6-1872-4847-906c-39ca7f619fad tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1570 microversion: 2.1 time: 0.151442 Sep 14 01:20:54.792089 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 588/1167] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:20:54 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:20:55.641223 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-be02e524-3965-4502-a39f-00ef4cb57b4f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:20:55.641924 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-be02e524-3965-4502-a39f-00ef4cb57b4f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:20:55.648570 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be02e524-3965-4502-a39f-00ef4cb57b4f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:55.649042 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be02e524-3965-4502-a39f-00ef4cb57b4f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:55.649467 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be02e524-3965-4502-a39f-00ef4cb57b4f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:55.650205 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be02e524-3965-4502-a39f-00ef4cb57b4f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:55.650655 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be02e524-3965-4502-a39f-00ef4cb57b4f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:55.651101 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-be02e524-3965-4502-a39f-00ef4cb57b4f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:55.815659 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-f2428d80-9ea4-497c-8a48-d27cb4b57520 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:20:55.816577 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-f2428d80-9ea4-497c-8a48-d27cb4b57520 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:20:55.823182 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f2428d80-9ea4-497c-8a48-d27cb4b57520 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:55.823698 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f2428d80-9ea4-497c-8a48-d27cb4b57520 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:55.824177 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f2428d80-9ea4-497c-8a48-d27cb4b57520 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:55.825433 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f2428d80-9ea4-497c-8a48-d27cb4b57520 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:55.825433 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f2428d80-9ea4-497c-8a48-d27cb4b57520 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:55.825754 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f2428d80-9ea4-497c-8a48-d27cb4b57520 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:55.920122 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-be02e524-3965-4502-a39f-00ef4cb57b4f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:20:55.928775 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-be02e524-3965-4502-a39f-00ef4cb57b4f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1576 microversion: 2.1 time: 0.291708 Sep 14 01:20:55.929349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 580/1168] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:20:55 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1576 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:20:55.967474 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-f2428d80-9ea4-497c-8a48-d27cb4b57520 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:20:55.976127 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-f2428d80-9ea4-497c-8a48-d27cb4b57520 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1570 microversion: 2.1 time: 0.164371 Sep 14 01:20:55.976802 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 589/1169] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:20:55 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:20:56.136341 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-e455c718-1455-4de2-9642-142e2e6aff40 req-a0a3a921-daea-41cf-afc2-b2b92eea5726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27979fc-e36a-4644-9d51-55c6c105c7a9", "name": "network-vif-deleted", "tag": "8c4592ba-3360-4783-a771-de0148eeab61"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:20:56.147969 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-e455c718-1455-4de2-9642-142e2e6aff40 req-a0a3a921-daea-41cf-afc2-b2b92eea5726 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:56.148452 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-e455c718-1455-4de2-9642-142e2e6aff40 req-a0a3a921-daea-41cf-afc2-b2b92eea5726 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:56.149231 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-e455c718-1455-4de2-9642-142e2e6aff40 req-a0a3a921-daea-41cf-afc2-b2b92eea5726 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:56.172919 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-e455c718-1455-4de2-9642-142e2e6aff40 req-a0a3a921-daea-41cf-afc2-b2b92eea5726 service nova] Creating event network-vif-deleted:8c4592ba-3360-4783-a771-de0148eeab61 for instance b27979fc-e36a-4644-9d51-55c6c105c7a9 on hv-cinder-85752 Sep 14 01:20:56.179226 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-e455c718-1455-4de2-9642-142e2e6aff40 req-a0a3a921-daea-41cf-afc2-b2b92eea5726 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046565 Sep 14 01:20:56.179867 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 581/1170] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:20:56.952292 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8c1e62d3-f162-4639-bf38-5f956b218cb1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:20:56.952866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8c1e62d3-f162-4639-bf38-5f956b218cb1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:20:56.960008 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c1e62d3-f162-4639-bf38-5f956b218cb1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:56.960507 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c1e62d3-f162-4639-bf38-5f956b218cb1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:56.960953 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c1e62d3-f162-4639-bf38-5f956b218cb1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:56.961662 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c1e62d3-f162-4639-bf38-5f956b218cb1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:56.962126 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c1e62d3-f162-4639-bf38-5f956b218cb1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:56.962555 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c1e62d3-f162-4639-bf38-5f956b218cb1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:56.995516 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c1e62d3-f162-4639-bf38-5f956b218cb1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:56.996026 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c1e62d3-f162-4639-bf38-5f956b218cb1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:56.996459 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8c1e62d3-f162-4639-bf38-5f956b218cb1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:56.996995 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.objects.instance [None req-8c1e62d3-f162-4639-bf38-5f956b218cb1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lazy-loading 'fault' on Instance uuid b27979fc-e36a-4644-9d51-55c6c105c7a9 {{(pid=120620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 01:20:57.000460 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-caed0bea-0453-4d4c-9fdc-feef58517c64 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:20:57.010914 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-caed0bea-0453-4d4c-9fdc-feef58517c64 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:20:57.018611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-caed0bea-0453-4d4c-9fdc-feef58517c64 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:57.019949 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-caed0bea-0453-4d4c-9fdc-feef58517c64 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:57.020603 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-caed0bea-0453-4d4c-9fdc-feef58517c64 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:57.021527 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-caed0bea-0453-4d4c-9fdc-feef58517c64 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:57.022165 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-caed0bea-0453-4d4c-9fdc-feef58517c64 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:57.022754 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-caed0bea-0453-4d4c-9fdc-feef58517c64 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:57.047216 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8c1e62d3-f162-4639-bf38-5f956b218cb1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:20:57.055275 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8c1e62d3-f162-4639-bf38-5f956b218cb1 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 200 len: 1230 microversion: 2.1 time: 0.107042 Sep 14 01:20:57.055874 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 590/1171] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:20:56 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:20:57.193794 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-caed0bea-0453-4d4c-9fdc-feef58517c64 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:20:57.208199 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-caed0bea-0453-4d4c-9fdc-feef58517c64 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1570 microversion: 2.1 time: 0.212559 Sep 14 01:20:57.209056 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 582/1172] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:20:56 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1570 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:20:58.083461 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8be5edc5-b974-485a-a1ef-a973f88af859 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:20:58.084023 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8be5edc5-b974-485a-a1ef-a973f88af859 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:20:58.090345 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8be5edc5-b974-485a-a1ef-a973f88af859 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:58.090817 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8be5edc5-b974-485a-a1ef-a973f88af859 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:58.091256 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8be5edc5-b974-485a-a1ef-a973f88af859 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:58.091954 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8be5edc5-b974-485a-a1ef-a973f88af859 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:58.092404 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8be5edc5-b974-485a-a1ef-a973f88af859 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:58.092819 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8be5edc5-b974-485a-a1ef-a973f88af859 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:58.106464 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-8be5edc5-b974-485a-a1ef-a973f88af859 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] HTTP exception thrown: Instance b27979fc-e36a-4644-9d51-55c6c105c7a9 could not be found. Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8be5edc5-b974-485a-a1ef-a973f88af859 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Request method failure captured: Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 HTTP/1.1 Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISufKo3aEOcjstYtTUvPgVsgJiKFjYP48TbC8t41inG0h0GWblYl-ma5xl95BIeVOgICqWJhmPFpsYQK_aMR1QST8oppf05IFqDc2ZuO5PFYpv0nhv_qvQT3pY9kRvKy5X8x9QZiG8WPLPsbSb0nGTyb3zJ_scOH7tWAequud3QCpTU Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 6c0d5a6539764b53852b5741347734a8 Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-TestVolumeBootPattern-1448431353 Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:20:58.108096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:20:58.109936 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6c0d5a6539764b53852b5741347734a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6c0d5a6539764b53852b5741347734a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6c0d5a6539764b53852b5741347734a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6c0d5a6539764b53852b5741347734a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:20:58.109936 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-TestVolumeBootPattern-1448431353 Sep 14 01:20:58.109936 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 6c0d5a6539764b53852b5741347734a8 Sep 14 01:20:58.109936 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-TestVolumeBootPattern-1448431353 Sep 14 01:20:58.109936 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-TestVolumeBootPattern-1448431353-project Sep 14 01:20:58.109936 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:20:58.109936 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:20:58.109936 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: b1494511685b47519f4aa0674009fbfc Sep 14 01:20:58.109936 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-TestVolumeBootPattern-1448431353-project Sep 14 01:20:58.109936 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:20:58.109936 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance b27979fc-e36a-4644-9d51-55c6c105c7a9 could not be found. Sep 14 01:20:58.109936 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': 'b27979fc-e36a-4644-9d51-55c6c105c7a9'} Sep 14 01:20:58.111037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:20:58.111037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:20:58.111037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:20:58.111037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:20:58.111037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:20:58.111037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:20:58.111037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:20:58.111037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:20:58.111037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:20:58.111037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:20:58.111037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27979fc-e36a-4644-9d51-55c6c105c7a9 could not be found. Sep 14 01:20:58.111037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:20:58.111037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:20:58.111037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:20:58.111037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:20:58.111037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:20:58.111037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:20:58.111037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:20:58.111037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:20:58.111037 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:20:58.112933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:20:58.112933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:20:58.112933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:20:58.112933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:20:58.112933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:20:58.112933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:20:58.112933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:20:58.112933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27979fc-e36a-4644-9d51-55c6c105c7a9 could not be found. Sep 14 01:20:58.112933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:20:58.112933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:20:58.112933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:20:58.112933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:20:58.112933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:20:58.112933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:20:58.112933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:20:58.112933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:20:58.112933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27979fc-e36a-4644-9d51-55c6c105c7a9 could not be found. Sep 14 01:20:58.112933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:20:58.114449 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8be5edc5-b974-485a-a1ef-a973f88af859 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Returning 404 to user: Instance b27979fc-e36a-4644-9d51-55c6c105c7a9 could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:20:58.114449 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8be5edc5-b974-485a-a1ef-a973f88af859 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 404 len: 111 microversion: 2.1 time: 0.030488 Sep 14 01:20:58.114449 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 591/1173] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:20:58 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:20:58.156746 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ec757dd9-0e87-4947-bba1-f35a82170fc7 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-737338813", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-787735033", "security_groups": [{"name": "tempest-secgroup-smoke-166959226"}], "block_device_mapping_v2": [{"uuid": "d2c03139-0b4c-4fc7-a81b-39aa744ab24c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cef33139-f42c-4679-8281-e97f735186d9"}]}} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:20:58.232902 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-1e4e962c-a153-4955-a578-9c69ce285a9c tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:20:58.233602 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-1e4e962c-a153-4955-a578-9c69ce285a9c tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:20:58.240146 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1e4e962c-a153-4955-a578-9c69ce285a9c tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:58.240641 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1e4e962c-a153-4955-a578-9c69ce285a9c tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:58.241115 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1e4e962c-a153-4955-a578-9c69ce285a9c tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:58.241823 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1e4e962c-a153-4955-a578-9c69ce285a9c tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:58.242317 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1e4e962c-a153-4955-a578-9c69ce285a9c tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:58.242777 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-1e4e962c-a153-4955-a578-9c69ce285a9c tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:58.272617 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.network.neutron [None req-ec757dd9-0e87-4947-bba1-f35a82170fc7 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] validate_networks() for [('cef33139-f42c-4679-8281-e97f735186d9', None, None, None, None, None)] {{(pid=120621) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:20:58.381484 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-1e4e962c-a153-4955-a578-9c69ce285a9c tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:20:58.389531 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-1e4e962c-a153-4955-a578-9c69ce285a9c tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1570 microversion: 2.1 time: 0.160408 Sep 14 01:20:58.390180 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 592/1174] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:20:58 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:20:58.642865 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-ec757dd9-0e87-4947-bba1-f35a82170fc7 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Flavor limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:20:58.643286 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-ec757dd9-0e87-4947-bba1-f35a82170fc7 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Image limits 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:20:58.644546 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-ec757dd9-0e87-4947-bba1-f35a82170fc7 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Flavor pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:20:58.644961 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-ec757dd9-0e87-4947-bba1-f35a82170fc7 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Image pref 0:0:0 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:20:58.645370 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.virt.hardware [None req-ec757dd9-0e87-4947-bba1-f35a82170fc7 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:20:58.654348 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ec757dd9-0e87-4947-bba1-f35a82170fc7 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:58.654829 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ec757dd9-0e87-4947-bba1-f35a82170fc7 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:58.655263 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ec757dd9-0e87-4947-bba1-f35a82170fc7 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:58.656014 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ec757dd9-0e87-4947-bba1-f35a82170fc7 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:58.656471 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ec757dd9-0e87-4947-bba1-f35a82170fc7 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:58.656896 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ec757dd9-0e87-4947-bba1-f35a82170fc7 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:58.673215 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-ec757dd9-0e87-4947-bba1-f35a82170fc7 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Getting quotas for project 6c0d5a6539764b53852b5741347734a8. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:20:58.677618 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.quota [None req-ec757dd9-0e87-4947-bba1-f35a82170fc7 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Getting quotas for user b1494511685b47519f4aa0674009fbfc and project 6c0d5a6539764b53852b5741347734a8. Resources: {'cores', 'instances', 'ram'} {{(pid=120621) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:20:58.734985 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ec757dd9-0e87-4947-bba1-f35a82170fc7 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Going to run 1 instances... {{(pid=120621) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:20:58.737125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ec757dd9-0e87-4947-bba1-f35a82170fc7 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d2c03139-0b4c-4fc7-a81b-39aa744ab24c',volume_size=None,volume_type=None)] {{(pid=120621) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:20:58.875344 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ec757dd9-0e87-4947-bba1-f35a82170fc7 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.722497 Sep 14 01:20:58.876022 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 583/1175] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 01:20:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 01:20:58.887985 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-edaeb1f5-5a96-4ab3-93cb-97e83d306265 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:20:58.888860 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-edaeb1f5-5a96-4ab3-93cb-97e83d306265 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:20:58.944563 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-edaeb1f5-5a96-4ab3-93cb-97e83d306265 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:20:58.953285 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-edaeb1f5-5a96-4ab3-93cb-97e83d306265 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1093 microversion: 2.1 time: 0.069257 Sep 14 01:20:58.954052 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 593/1176] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:20:58 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:20:59.413890 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f6677527-f451-4271-888f-c67202b953f0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:20:59.414488 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f6677527-f451-4271-888f-c67202b953f0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:20:59.421039 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f6677527-f451-4271-888f-c67202b953f0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:59.421522 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f6677527-f451-4271-888f-c67202b953f0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:59.421959 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f6677527-f451-4271-888f-c67202b953f0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:59.422653 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f6677527-f451-4271-888f-c67202b953f0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:59.423105 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f6677527-f451-4271-888f-c67202b953f0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:59.423530 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f6677527-f451-4271-888f-c67202b953f0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:59.563695 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f6677527-f451-4271-888f-c67202b953f0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:20:59.572110 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f6677527-f451-4271-888f-c67202b953f0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1570 microversion: 2.1 time: 0.162296 Sep 14 01:20:59.572679 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 584/1177] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:20:59 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:20:59.976558 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8e605a19-3166-4d40-ad0f-5455add76dff tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:20:59.977163 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8e605a19-3166-4d40-ad0f-5455add76dff tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:20:59.983475 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8e605a19-3166-4d40-ad0f-5455add76dff tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:59.983982 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8e605a19-3166-4d40-ad0f-5455add76dff tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:59.984416 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8e605a19-3166-4d40-ad0f-5455add76dff tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:20:59.985096 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8e605a19-3166-4d40-ad0f-5455add76dff tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:20:59.985548 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8e605a19-3166-4d40-ad0f-5455add76dff tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:20:59.985965 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8e605a19-3166-4d40-ad0f-5455add76dff tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:00.047120 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8e605a19-3166-4d40-ad0f-5455add76dff tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:00.055459 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8e605a19-3166-4d40-ad0f-5455add76dff tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1191 microversion: 2.1 time: 0.083649 Sep 14 01:21:00.056054 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 594/1178] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:20:59 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:00.595168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-f75f4fe4-40f1-4446-8e36-b21f379d5051 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:00.595794 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-f75f4fe4-40f1-4446-8e36-b21f379d5051 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:00.605104 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f75f4fe4-40f1-4446-8e36-b21f379d5051 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:00.605481 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f75f4fe4-40f1-4446-8e36-b21f379d5051 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:00.605921 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f75f4fe4-40f1-4446-8e36-b21f379d5051 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:00.606908 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f75f4fe4-40f1-4446-8e36-b21f379d5051 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:00.607368 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f75f4fe4-40f1-4446-8e36-b21f379d5051 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:00.607819 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-f75f4fe4-40f1-4446-8e36-b21f379d5051 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:00.742964 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-f75f4fe4-40f1-4446-8e36-b21f379d5051 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:00.751237 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-f75f4fe4-40f1-4446-8e36-b21f379d5051 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1570 microversion: 2.1 time: 0.159860 Sep 14 01:21:00.751844 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 585/1179] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:00 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:01.078361 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-17d32acf-dbbe-45be-b068-82e2af59822c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:01.078894 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-17d32acf-dbbe-45be-b068-82e2af59822c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:01.086567 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17d32acf-dbbe-45be-b068-82e2af59822c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:01.087059 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17d32acf-dbbe-45be-b068-82e2af59822c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:01.087498 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17d32acf-dbbe-45be-b068-82e2af59822c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:01.088257 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17d32acf-dbbe-45be-b068-82e2af59822c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:01.088713 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17d32acf-dbbe-45be-b068-82e2af59822c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:01.089137 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17d32acf-dbbe-45be-b068-82e2af59822c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:01.150427 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-17d32acf-dbbe-45be-b068-82e2af59822c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:01.158138 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-17d32acf-dbbe-45be-b068-82e2af59822c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1191 microversion: 2.1 time: 0.083930 Sep 14 01:21:01.158696 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 595/1180] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:01 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:01.776165 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-107c913a-72f7-4fbb-bc2c-5e68995b8c1a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:01.777638 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-107c913a-72f7-4fbb-bc2c-5e68995b8c1a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:01.786596 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-107c913a-72f7-4fbb-bc2c-5e68995b8c1a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:01.787261 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-107c913a-72f7-4fbb-bc2c-5e68995b8c1a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:01.787828 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-107c913a-72f7-4fbb-bc2c-5e68995b8c1a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:01.788658 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-107c913a-72f7-4fbb-bc2c-5e68995b8c1a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:01.789223 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-107c913a-72f7-4fbb-bc2c-5e68995b8c1a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:01.789754 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-107c913a-72f7-4fbb-bc2c-5e68995b8c1a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:02.019498 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-107c913a-72f7-4fbb-bc2c-5e68995b8c1a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:02.029017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-107c913a-72f7-4fbb-bc2c-5e68995b8c1a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1570 microversion: 2.1 time: 0.256649 Sep 14 01:21:02.029593 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 586/1181] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:01 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1570 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:02.182668 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-28b41d57-5223-447b-b9b8-37cb7c525943 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:02.183284 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-28b41d57-5223-447b-b9b8-37cb7c525943 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:02.191823 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-28b41d57-5223-447b-b9b8-37cb7c525943 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:02.192252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-28b41d57-5223-447b-b9b8-37cb7c525943 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:02.192719 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-28b41d57-5223-447b-b9b8-37cb7c525943 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:02.193506 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-28b41d57-5223-447b-b9b8-37cb7c525943 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:02.193991 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-28b41d57-5223-447b-b9b8-37cb7c525943 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:02.194419 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-28b41d57-5223-447b-b9b8-37cb7c525943 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:02.344295 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-28b41d57-5223-447b-b9b8-37cb7c525943 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:02.353437 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-28b41d57-5223-447b-b9b8-37cb7c525943 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1276 microversion: 2.1 time: 0.176272 Sep 14 01:21:02.359370 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 596/1182] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:02 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:03.053393 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6ee0d48c-5a8e-4b03-8fca-b3f84fa7c62a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:03.054002 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6ee0d48c-5a8e-4b03-8fca-b3f84fa7c62a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:03.060436 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ee0d48c-5a8e-4b03-8fca-b3f84fa7c62a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:03.060921 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ee0d48c-5a8e-4b03-8fca-b3f84fa7c62a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:03.061349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ee0d48c-5a8e-4b03-8fca-b3f84fa7c62a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:03.062038 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ee0d48c-5a8e-4b03-8fca-b3f84fa7c62a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:03.062486 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ee0d48c-5a8e-4b03-8fca-b3f84fa7c62a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:03.062898 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6ee0d48c-5a8e-4b03-8fca-b3f84fa7c62a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:03.271392 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6ee0d48c-5a8e-4b03-8fca-b3f84fa7c62a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:03.279512 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6ee0d48c-5a8e-4b03-8fca-b3f84fa7c62a tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1511 microversion: 2.1 time: 0.230259 Sep 14 01:21:03.280113 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 587/1183] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:03 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1511 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:03.302369 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-ceaa039d-5f7c-435a-abb6-ec2b9ff78914 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:21:03.302896 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ceaa039d-5f7c-435a-abb6-ec2b9ff78914 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:03.309383 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ceaa039d-5f7c-435a-abb6-ec2b9ff78914 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:03.309866 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ceaa039d-5f7c-435a-abb6-ec2b9ff78914 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:03.310300 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ceaa039d-5f7c-435a-abb6-ec2b9ff78914 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:03.310997 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ceaa039d-5f7c-435a-abb6-ec2b9ff78914 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:03.311452 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ceaa039d-5f7c-435a-abb6-ec2b9ff78914 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:03.311901 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-ceaa039d-5f7c-435a-abb6-ec2b9ff78914 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:03.378740 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-db2a361d-78e9-479b-b0ff-cd882de959b6 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:03.380387 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-db2a361d-78e9-479b-b0ff-cd882de959b6 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:03.394049 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-db2a361d-78e9-479b-b0ff-cd882de959b6 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:03.395048 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-db2a361d-78e9-479b-b0ff-cd882de959b6 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:03.395806 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-db2a361d-78e9-479b-b0ff-cd882de959b6 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:03.396524 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-db2a361d-78e9-479b-b0ff-cd882de959b6 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:03.396984 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-db2a361d-78e9-479b-b0ff-cd882de959b6 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:03.397414 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-db2a361d-78e9-479b-b0ff-cd882de959b6 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:03.399431 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-ceaa039d-5f7c-435a-abb6-ec2b9ff78914 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120620) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 01:21:03.478823 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-ceaa039d-5f7c-435a-abb6-ec2b9ff78914 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "POST /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d/action" status: 202 len: 0 microversion: 2.1 time: 0.180925 Sep 14 01:21:03.483161 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 597/1184] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 01:21:03 2022] POST /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:21:03.488141 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-709283b0-055a-4ad7-9415-e9507ac1da82 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:03.489496 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-709283b0-055a-4ad7-9415-e9507ac1da82 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:03.496405 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-709283b0-055a-4ad7-9415-e9507ac1da82 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:03.497124 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-709283b0-055a-4ad7-9415-e9507ac1da82 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:03.497766 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-709283b0-055a-4ad7-9415-e9507ac1da82 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:03.498695 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-709283b0-055a-4ad7-9415-e9507ac1da82 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:03.499353 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-709283b0-055a-4ad7-9415-e9507ac1da82 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:03.500020 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-709283b0-055a-4ad7-9415-e9507ac1da82 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:03.642461 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-709283b0-055a-4ad7-9415-e9507ac1da82 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:03.651238 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-709283b0-055a-4ad7-9415-e9507ac1da82 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1519 microversion: 2.1 time: 0.166862 Sep 14 01:21:03.651848 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 598/1185] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:03 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:03.658291 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-1b140eb8-bcca-4858-9194-0ed92b7b4679 req-f7c95c4e-20cc-4092-ada1-bf8df46af53b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b8a87a-9d23-48ed-ae9c-d765346329b7", "tag": "a5136ef8-e5ed-45d7-b1a8-5c87cacb64c2"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:21:03.666582 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-1b140eb8-bcca-4858-9194-0ed92b7b4679 req-f7c95c4e-20cc-4092-ada1-bf8df46af53b service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:03.667063 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-1b140eb8-bcca-4858-9194-0ed92b7b4679 req-f7c95c4e-20cc-4092-ada1-bf8df46af53b service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:03.667495 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-1b140eb8-bcca-4858-9194-0ed92b7b4679 req-f7c95c4e-20cc-4092-ada1-bf8df46af53b service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:03.671541 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:21:03.680764 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-1b140eb8-bcca-4858-9194-0ed92b7b4679 req-f7c95c4e-20cc-4092-ada1-bf8df46af53b service nova] Creating event network-changed:a5136ef8-e5ed-45d7-b1a8-5c87cacb64c2 for instance e0b8a87a-9d23-48ed-ae9c-d765346329b7 on hv-cinder-85752 Sep 14 01:21:03.686922 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-1b140eb8-bcca-4858-9194-0ed92b7b4679 req-f7c95c4e-20cc-4092-ada1-bf8df46af53b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033903 Sep 14 01:21:03.688048 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 599/1186] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:21:03.762403 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-db2a361d-78e9-479b-b0ff-cd882de959b6 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:03.771046 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-db2a361d-78e9-479b-b0ff-cd882de959b6 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1264 microversion: 2.1 time: 0.395957 Sep 14 01:21:03.771671 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 588/1187] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:03 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1264 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:21:04.628036 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-e219d07e-b2af-43c1-9353-62ad3b31d37d req-992ba299-52a0-459b-9b49-d30aced52afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5047389f-d232-432f-a459-bc4b023c358d", "name": "network-vif-unplugged", "status": "completed", "tag": "95cbc616-90a4-4fe0-8288-92d9ab2f32b3"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:21:04.640155 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-e219d07e-b2af-43c1-9353-62ad3b31d37d req-992ba299-52a0-459b-9b49-d30aced52afa service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:04.640634 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-e219d07e-b2af-43c1-9353-62ad3b31d37d req-992ba299-52a0-459b-9b49-d30aced52afa service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:04.641260 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-e219d07e-b2af-43c1-9353-62ad3b31d37d req-992ba299-52a0-459b-9b49-d30aced52afa service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:04.655780 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.compute.server_external_events [req-e219d07e-b2af-43c1-9353-62ad3b31d37d req-992ba299-52a0-459b-9b49-d30aced52afa service nova] Unable to find a host for instance 5047389f-d232-432f-a459-bc4b023c358d. Dropping event network-vif-unplugged {{(pid=120620) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 14 01:21:04.656664 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-e219d07e-b2af-43c1-9353-62ad3b31d37d req-992ba299-52a0-459b-9b49-d30aced52afa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033399 Sep 14 01:21:04.657253 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 600/1188] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 14 01:21:04.674249 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c0518cbf-bb52-4383-b753-3b12844292b3 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:04.674883 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c0518cbf-bb52-4383-b753-3b12844292b3 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:04.681824 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c0518cbf-bb52-4383-b753-3b12844292b3 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:04.682300 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c0518cbf-bb52-4383-b753-3b12844292b3 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:04.682729 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c0518cbf-bb52-4383-b753-3b12844292b3 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:04.683414 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c0518cbf-bb52-4383-b753-3b12844292b3 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:04.683895 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c0518cbf-bb52-4383-b753-3b12844292b3 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:04.684312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c0518cbf-bb52-4383-b753-3b12844292b3 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:04.794541 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7deea4dd-8166-40d0-a18b-d24a06218f51 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:04.795395 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7deea4dd-8166-40d0-a18b-d24a06218f51 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:04.802253 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7deea4dd-8166-40d0-a18b-d24a06218f51 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:04.803030 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7deea4dd-8166-40d0-a18b-d24a06218f51 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:04.803672 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7deea4dd-8166-40d0-a18b-d24a06218f51 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:04.804384 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7deea4dd-8166-40d0-a18b-d24a06218f51 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:04.804992 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7deea4dd-8166-40d0-a18b-d24a06218f51 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:04.806331 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7deea4dd-8166-40d0-a18b-d24a06218f51 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:04.825344 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c0518cbf-bb52-4383-b753-3b12844292b3 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:04.833786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c0518cbf-bb52-4383-b753-3b12844292b3 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1519 microversion: 2.1 time: 0.163464 Sep 14 01:21:04.834337 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 589/1189] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:04 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:04.952927 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7deea4dd-8166-40d0-a18b-d24a06218f51 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:04.961811 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7deea4dd-8166-40d0-a18b-d24a06218f51 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1264 microversion: 2.1 time: 0.171042 Sep 14 01:21:04.962390 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 601/1190] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:04 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:21:05.858420 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8524a523-1ede-4851-8cc0-6d4c7eebded0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:05.859809 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8524a523-1ede-4851-8cc0-6d4c7eebded0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:05.867747 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8524a523-1ede-4851-8cc0-6d4c7eebded0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:05.868269 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8524a523-1ede-4851-8cc0-6d4c7eebded0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:05.868743 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8524a523-1ede-4851-8cc0-6d4c7eebded0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:05.869634 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8524a523-1ede-4851-8cc0-6d4c7eebded0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:05.870109 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8524a523-1ede-4851-8cc0-6d4c7eebded0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:05.870650 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8524a523-1ede-4851-8cc0-6d4c7eebded0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:05.984169 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7ba7fef5-a9f9-4c8f-88b7-0c04994c73f8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:05.984777 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7ba7fef5-a9f9-4c8f-88b7-0c04994c73f8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:05.992329 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ba7fef5-a9f9-4c8f-88b7-0c04994c73f8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:05.992816 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ba7fef5-a9f9-4c8f-88b7-0c04994c73f8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:05.993253 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ba7fef5-a9f9-4c8f-88b7-0c04994c73f8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:05.993943 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ba7fef5-a9f9-4c8f-88b7-0c04994c73f8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:05.994396 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ba7fef5-a9f9-4c8f-88b7-0c04994c73f8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:05.994817 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7ba7fef5-a9f9-4c8f-88b7-0c04994c73f8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:06.007057 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8524a523-1ede-4851-8cc0-6d4c7eebded0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:06.010771 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:21:06.016412 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8524a523-1ede-4851-8cc0-6d4c7eebded0 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1577 microversion: 2.1 time: 0.162026 Sep 14 01:21:06.016985 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 590/1191] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:05 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:06.129961 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7ba7fef5-a9f9-4c8f-88b7-0c04994c73f8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:06.137645 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7ba7fef5-a9f9-4c8f-88b7-0c04994c73f8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1264 microversion: 2.1 time: 0.157349 Sep 14 01:21:06.138210 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 602/1192] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:05 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:21:07.040136 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e02533b3-b52f-4d36-9a31-e1153602b83c tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:07.040744 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e02533b3-b52f-4d36-9a31-e1153602b83c tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:07.048720 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e02533b3-b52f-4d36-9a31-e1153602b83c tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:07.049314 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e02533b3-b52f-4d36-9a31-e1153602b83c tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:07.049748 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e02533b3-b52f-4d36-9a31-e1153602b83c tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:07.050436 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e02533b3-b52f-4d36-9a31-e1153602b83c tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:07.051422 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e02533b3-b52f-4d36-9a31-e1153602b83c tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:07.051899 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e02533b3-b52f-4d36-9a31-e1153602b83c tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:07.161644 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-f6d9a02f-1a2c-49e2-a141-da3ee79b212c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:07.162259 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-f6d9a02f-1a2c-49e2-a141-da3ee79b212c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:07.169289 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f6d9a02f-1a2c-49e2-a141-da3ee79b212c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:07.169775 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f6d9a02f-1a2c-49e2-a141-da3ee79b212c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:07.170215 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f6d9a02f-1a2c-49e2-a141-da3ee79b212c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:07.171162 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f6d9a02f-1a2c-49e2-a141-da3ee79b212c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:07.171648 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f6d9a02f-1a2c-49e2-a141-da3ee79b212c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:07.172073 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f6d9a02f-1a2c-49e2-a141-da3ee79b212c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:07.183173 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e02533b3-b52f-4d36-9a31-e1153602b83c tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:07.191003 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e02533b3-b52f-4d36-9a31-e1153602b83c tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1577 microversion: 2.1 time: 0.154806 Sep 14 01:21:07.191762 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 591/1193] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:07 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:07.301665 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-f6d9a02f-1a2c-49e2-a141-da3ee79b212c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:07.309250 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-f6d9a02f-1a2c-49e2-a141-da3ee79b212c tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1264 microversion: 2.1 time: 0.152233 Sep 14 01:21:07.309815 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 603/1194] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:07 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:21:08.214205 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0839218e-f786-4ece-bb05-97fd092088ed tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:08.214848 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0839218e-f786-4ece-bb05-97fd092088ed tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:08.224168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0839218e-f786-4ece-bb05-97fd092088ed tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:08.224738 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0839218e-f786-4ece-bb05-97fd092088ed tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:08.225182 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0839218e-f786-4ece-bb05-97fd092088ed tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:08.225881 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0839218e-f786-4ece-bb05-97fd092088ed tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:08.226343 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0839218e-f786-4ece-bb05-97fd092088ed tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:08.226777 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0839218e-f786-4ece-bb05-97fd092088ed tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:08.332785 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-716368b2-cb52-4283-a692-78e1791c4ff8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:08.334016 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-716368b2-cb52-4283-a692-78e1791c4ff8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:08.342001 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-716368b2-cb52-4283-a692-78e1791c4ff8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:08.342564 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-716368b2-cb52-4283-a692-78e1791c4ff8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:08.343182 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-716368b2-cb52-4283-a692-78e1791c4ff8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:08.343922 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-716368b2-cb52-4283-a692-78e1791c4ff8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:08.344366 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-716368b2-cb52-4283-a692-78e1791c4ff8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:08.344789 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-716368b2-cb52-4283-a692-78e1791c4ff8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:08.363983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0839218e-f786-4ece-bb05-97fd092088ed tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:08.371865 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0839218e-f786-4ece-bb05-97fd092088ed tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1577 microversion: 2.1 time: 0.161525 Sep 14 01:21:08.372781 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 592/1195] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:08 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:08.479956 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-716368b2-cb52-4283-a692-78e1791c4ff8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:08.487696 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-716368b2-cb52-4283-a692-78e1791c4ff8 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1264 microversion: 2.1 time: 0.159520 Sep 14 01:21:08.488958 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 604/1196] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:08 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:21:09.395547 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-9c6a715d-e920-453d-a8a3-73e258a1d4e5 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:09.396215 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-9c6a715d-e920-453d-a8a3-73e258a1d4e5 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:09.398072 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:21:09.398729 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=6 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:21:09.405449 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9c6a715d-e920-453d-a8a3-73e258a1d4e5 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:09.405936 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9c6a715d-e920-453d-a8a3-73e258a1d4e5 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:09.406376 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9c6a715d-e920-453d-a8a3-73e258a1d4e5 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:09.407067 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9c6a715d-e920-453d-a8a3-73e258a1d4e5 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:09.407525 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9c6a715d-e920-453d-a8a3-73e258a1d4e5 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:09.407982 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-9c6a715d-e920-453d-a8a3-73e258a1d4e5 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:09.512066 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a528ad63-5f74-4499-bab7-dce216dd3d59 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:09.512609 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a528ad63-5f74-4499-bab7-dce216dd3d59 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:09.515939 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=2 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:21:09.520863 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a528ad63-5f74-4499-bab7-dce216dd3d59 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:09.521355 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a528ad63-5f74-4499-bab7-dce216dd3d59 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:09.521793 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a528ad63-5f74-4499-bab7-dce216dd3d59 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:09.522492 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a528ad63-5f74-4499-bab7-dce216dd3d59 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:09.522947 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a528ad63-5f74-4499-bab7-dce216dd3d59 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:09.523371 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a528ad63-5f74-4499-bab7-dce216dd3d59 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:09.541785 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-9c6a715d-e920-453d-a8a3-73e258a1d4e5 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:09.549538 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-9c6a715d-e920-453d-a8a3-73e258a1d4e5 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1577 microversion: 2.1 time: 0.158858 Sep 14 01:21:09.550107 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 593/1197] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:09 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:09.653162 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a528ad63-5f74-4499-bab7-dce216dd3d59 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:09.660874 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a528ad63-5f74-4499-bab7-dce216dd3d59 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1264 microversion: 2.1 time: 0.152807 Sep 14 01:21:09.661438 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 605/1198] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:09 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:21:10.573057 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-2f5ee02a-d408-436b-9e6e-0000cfeb22d1 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:10.573599 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-2f5ee02a-d408-436b-9e6e-0000cfeb22d1 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:10.580000 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f5ee02a-d408-436b-9e6e-0000cfeb22d1 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:10.580475 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f5ee02a-d408-436b-9e6e-0000cfeb22d1 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:10.580903 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f5ee02a-d408-436b-9e6e-0000cfeb22d1 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:10.581579 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f5ee02a-d408-436b-9e6e-0000cfeb22d1 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:10.582266 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f5ee02a-d408-436b-9e6e-0000cfeb22d1 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:10.583145 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-2f5ee02a-d408-436b-9e6e-0000cfeb22d1 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:10.684316 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-8d745932-f319-4976-972e-770c1e6b3410 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:10.684316 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-8d745932-f319-4976-972e-770c1e6b3410 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:10.694952 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d745932-f319-4976-972e-770c1e6b3410 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:10.695520 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d745932-f319-4976-972e-770c1e6b3410 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:10.695983 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d745932-f319-4976-972e-770c1e6b3410 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:10.696681 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d745932-f319-4976-972e-770c1e6b3410 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:10.697135 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d745932-f319-4976-972e-770c1e6b3410 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:10.697554 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-8d745932-f319-4976-972e-770c1e6b3410 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:10.717803 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-2f5ee02a-d408-436b-9e6e-0000cfeb22d1 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:10.726212 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-2f5ee02a-d408-436b-9e6e-0000cfeb22d1 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1577 microversion: 2.1 time: 0.157036 Sep 14 01:21:10.726783 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 594/1199] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:10 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:10.835905 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-8d745932-f319-4976-972e-770c1e6b3410 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:10.843425 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-8d745932-f319-4976-972e-770c1e6b3410 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1264 microversion: 2.1 time: 0.164475 Sep 14 01:21:10.844013 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 606/1200] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:10 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:11.750306 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e5921a70-2540-4117-87d6-06c8f4731588 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:11.750866 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e5921a70-2540-4117-87d6-06c8f4731588 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:11.758365 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e5921a70-2540-4117-87d6-06c8f4731588 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:11.758836 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e5921a70-2540-4117-87d6-06c8f4731588 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:11.759267 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e5921a70-2540-4117-87d6-06c8f4731588 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:11.759983 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e5921a70-2540-4117-87d6-06c8f4731588 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:11.760428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e5921a70-2540-4117-87d6-06c8f4731588 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:11.760844 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e5921a70-2540-4117-87d6-06c8f4731588 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:11.868169 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-7b792406-4212-4d29-a83d-9764fd3a3689 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:11.868786 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-7b792406-4212-4d29-a83d-9764fd3a3689 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:11.875786 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7b792406-4212-4d29-a83d-9764fd3a3689 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:11.876290 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7b792406-4212-4d29-a83d-9764fd3a3689 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:11.876717 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7b792406-4212-4d29-a83d-9764fd3a3689 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:11.877413 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7b792406-4212-4d29-a83d-9764fd3a3689 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:11.877872 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7b792406-4212-4d29-a83d-9764fd3a3689 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:11.878297 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-7b792406-4212-4d29-a83d-9764fd3a3689 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:11.890382 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e5921a70-2540-4117-87d6-06c8f4731588 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:11.898583 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e5921a70-2540-4117-87d6-06c8f4731588 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1577 microversion: 2.1 time: 0.152205 Sep 14 01:21:11.899155 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 595/1201] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:11 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:12.008335 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-7b792406-4212-4d29-a83d-9764fd3a3689 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:12.016209 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-7b792406-4212-4d29-a83d-9764fd3a3689 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1264 microversion: 2.1 time: 0.151901 Sep 14 01:21:12.016776 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 607/1202] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:11 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:21:12.922240 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8d9de0e4-2c32-4fcb-a737-e8dcff2fabf2 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:12.922856 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8d9de0e4-2c32-4fcb-a737-e8dcff2fabf2 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:12.929622 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d9de0e4-2c32-4fcb-a737-e8dcff2fabf2 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:12.930106 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d9de0e4-2c32-4fcb-a737-e8dcff2fabf2 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:12.930542 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d9de0e4-2c32-4fcb-a737-e8dcff2fabf2 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:12.931259 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d9de0e4-2c32-4fcb-a737-e8dcff2fabf2 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:12.931746 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d9de0e4-2c32-4fcb-a737-e8dcff2fabf2 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:12.932174 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8d9de0e4-2c32-4fcb-a737-e8dcff2fabf2 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:13.038317 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-d8c92488-76ec-4c0d-9f92-2bb9fa5a7152 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:13.038933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-d8c92488-76ec-4c0d-9f92-2bb9fa5a7152 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:13.045845 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d8c92488-76ec-4c0d-9f92-2bb9fa5a7152 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:13.046336 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d8c92488-76ec-4c0d-9f92-2bb9fa5a7152 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:13.047801 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d8c92488-76ec-4c0d-9f92-2bb9fa5a7152 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:13.048892 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d8c92488-76ec-4c0d-9f92-2bb9fa5a7152 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:13.049394 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d8c92488-76ec-4c0d-9f92-2bb9fa5a7152 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:13.050447 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-d8c92488-76ec-4c0d-9f92-2bb9fa5a7152 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:13.064610 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8d9de0e4-2c32-4fcb-a737-e8dcff2fabf2 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:13.072977 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8d9de0e4-2c32-4fcb-a737-e8dcff2fabf2 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1577 microversion: 2.1 time: 0.154579 Sep 14 01:21:13.075705 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 596/1203] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:12 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:13.184855 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-d8c92488-76ec-4c0d-9f92-2bb9fa5a7152 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:13.192586 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-d8c92488-76ec-4c0d-9f92-2bb9fa5a7152 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1264 microversion: 2.1 time: 0.158246 Sep 14 01:21:13.193168 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 608/1204] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:13 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:21:14.095468 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-ea46c8cd-c808-4aad-aefe-2f8d3604f766 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:14.096043 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-ea46c8cd-c808-4aad-aefe-2f8d3604f766 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:14.102984 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ea46c8cd-c808-4aad-aefe-2f8d3604f766 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:14.103467 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ea46c8cd-c808-4aad-aefe-2f8d3604f766 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:14.103941 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ea46c8cd-c808-4aad-aefe-2f8d3604f766 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:14.104637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ea46c8cd-c808-4aad-aefe-2f8d3604f766 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:14.105175 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ea46c8cd-c808-4aad-aefe-2f8d3604f766 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:14.105720 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-ea46c8cd-c808-4aad-aefe-2f8d3604f766 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:14.215302 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-852b22a5-0002-42c8-9795-6e4a30bfa2e9 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:14.215931 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-852b22a5-0002-42c8-9795-6e4a30bfa2e9 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:14.222259 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-852b22a5-0002-42c8-9795-6e4a30bfa2e9 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:14.223502 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-852b22a5-0002-42c8-9795-6e4a30bfa2e9 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:14.224195 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-852b22a5-0002-42c8-9795-6e4a30bfa2e9 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:14.224901 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-852b22a5-0002-42c8-9795-6e4a30bfa2e9 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:14.225357 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-852b22a5-0002-42c8-9795-6e4a30bfa2e9 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:14.225777 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-852b22a5-0002-42c8-9795-6e4a30bfa2e9 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:14.240333 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-ea46c8cd-c808-4aad-aefe-2f8d3604f766 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:14.247973 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-ea46c8cd-c808-4aad-aefe-2f8d3604f766 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1577 microversion: 2.1 time: 0.156371 Sep 14 01:21:14.248537 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 597/1205] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:14 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:14.358734 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-852b22a5-0002-42c8-9795-6e4a30bfa2e9 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:14.367280 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-852b22a5-0002-42c8-9795-6e4a30bfa2e9 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1264 microversion: 2.1 time: 0.155813 Sep 14 01:21:14.367883 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 609/1206] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:14 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:21:14.848843 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-070a2224-2d16-4922-baf3-16e4e177baaf req-e7eeb887-f997-4c6a-b7c4-b46cab02690c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b8a87a-9d23-48ed-ae9c-d765346329b7", "name": "network-vif-plugged", "status": "completed", "tag": "a5136ef8-e5ed-45d7-b1a8-5c87cacb64c2"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:21:14.858277 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-070a2224-2d16-4922-baf3-16e4e177baaf req-e7eeb887-f997-4c6a-b7c4-b46cab02690c service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:14.858746 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-070a2224-2d16-4922-baf3-16e4e177baaf req-e7eeb887-f997-4c6a-b7c4-b46cab02690c service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:14.859173 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-070a2224-2d16-4922-baf3-16e4e177baaf req-e7eeb887-f997-4c6a-b7c4-b46cab02690c service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:14.870863 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-070a2224-2d16-4922-baf3-16e4e177baaf req-e7eeb887-f997-4c6a-b7c4-b46cab02690c service nova] Creating event network-vif-plugged:a5136ef8-e5ed-45d7-b1a8-5c87cacb64c2 for instance e0b8a87a-9d23-48ed-ae9c-d765346329b7 on hv-cinder-85752 Sep 14 01:21:14.875824 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-070a2224-2d16-4922-baf3-16e4e177baaf req-e7eeb887-f997-4c6a-b7c4-b46cab02690c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031556 Sep 14 01:21:14.876416 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 598/1207] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:21:15.271022 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a4c1dd8f-0af8-4ae6-8c00-b4df206d23a6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:15.271659 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a4c1dd8f-0af8-4ae6-8c00-b4df206d23a6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:15.278264 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a4c1dd8f-0af8-4ae6-8c00-b4df206d23a6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:15.279030 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a4c1dd8f-0af8-4ae6-8c00-b4df206d23a6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:15.279466 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a4c1dd8f-0af8-4ae6-8c00-b4df206d23a6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:15.280223 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a4c1dd8f-0af8-4ae6-8c00-b4df206d23a6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:15.280670 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a4c1dd8f-0af8-4ae6-8c00-b4df206d23a6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:15.281326 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a4c1dd8f-0af8-4ae6-8c00-b4df206d23a6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:15.390510 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-56b57f74-d49c-4432-ac16-0822c5828e3f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:15.391112 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-56b57f74-d49c-4432-ac16-0822c5828e3f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:15.399133 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56b57f74-d49c-4432-ac16-0822c5828e3f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:15.399648 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56b57f74-d49c-4432-ac16-0822c5828e3f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:15.400967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56b57f74-d49c-4432-ac16-0822c5828e3f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:15.401686 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56b57f74-d49c-4432-ac16-0822c5828e3f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:15.402144 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56b57f74-d49c-4432-ac16-0822c5828e3f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:15.402636 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-56b57f74-d49c-4432-ac16-0822c5828e3f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:15.429664 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a4c1dd8f-0af8-4ae6-8c00-b4df206d23a6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:15.438346 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a4c1dd8f-0af8-4ae6-8c00-b4df206d23a6 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1577 microversion: 2.1 time: 0.171536 Sep 14 01:21:15.439589 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 610/1208] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:15 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:15.561834 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-56b57f74-d49c-4432-ac16-0822c5828e3f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:15.569797 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-56b57f74-d49c-4432-ac16-0822c5828e3f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1264 microversion: 2.1 time: 0.183824 Sep 14 01:21:15.570366 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 599/1209] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:15 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:16.462245 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-187590d1-8f27-41db-a3c4-1eea80fe3c1f tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:16.462847 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-187590d1-8f27-41db-a3c4-1eea80fe3c1f tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:16.469206 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-187590d1-8f27-41db-a3c4-1eea80fe3c1f tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:16.469664 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-187590d1-8f27-41db-a3c4-1eea80fe3c1f tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:16.470097 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-187590d1-8f27-41db-a3c4-1eea80fe3c1f tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:16.470782 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-187590d1-8f27-41db-a3c4-1eea80fe3c1f tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:16.471234 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-187590d1-8f27-41db-a3c4-1eea80fe3c1f tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:16.471682 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-187590d1-8f27-41db-a3c4-1eea80fe3c1f tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:16.593099 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0fd5add5-aa9f-4a82-ac90-a642dd4a90b4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:16.593926 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0fd5add5-aa9f-4a82-ac90-a642dd4a90b4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:16.601030 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0fd5add5-aa9f-4a82-ac90-a642dd4a90b4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:16.601346 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0fd5add5-aa9f-4a82-ac90-a642dd4a90b4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:16.601918 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0fd5add5-aa9f-4a82-ac90-a642dd4a90b4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:16.602632 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0fd5add5-aa9f-4a82-ac90-a642dd4a90b4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:16.603088 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0fd5add5-aa9f-4a82-ac90-a642dd4a90b4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:16.603519 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0fd5add5-aa9f-4a82-ac90-a642dd4a90b4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:16.608238 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-187590d1-8f27-41db-a3c4-1eea80fe3c1f tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:16.626882 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-187590d1-8f27-41db-a3c4-1eea80fe3c1f tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1577 microversion: 2.1 time: 0.168444 Sep 14 01:21:16.627470 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 611/1210] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:16 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:16.740947 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0fd5add5-aa9f-4a82-ac90-a642dd4a90b4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:16.748729 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0fd5add5-aa9f-4a82-ac90-a642dd4a90b4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1264 microversion: 2.1 time: 0.159623 Sep 14 01:21:16.749292 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 600/1211] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:16 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:16.896461 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-5bf472c8-e705-47a3-8eee-62b6d77dbd9d req-8c984521-bc25-4c71-87c1-a8cf1f354684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5047389f-d232-432f-a459-bc4b023c358d", "name": "network-vif-plugged", "status": "completed", "tag": "95cbc616-90a4-4fe0-8288-92d9ab2f32b3"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:21:16.905834 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-5bf472c8-e705-47a3-8eee-62b6d77dbd9d req-8c984521-bc25-4c71-87c1-a8cf1f354684 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:16.906313 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-5bf472c8-e705-47a3-8eee-62b6d77dbd9d req-8c984521-bc25-4c71-87c1-a8cf1f354684 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:16.906743 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-5bf472c8-e705-47a3-8eee-62b6d77dbd9d req-8c984521-bc25-4c71-87c1-a8cf1f354684 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:16.918987 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-5bf472c8-e705-47a3-8eee-62b6d77dbd9d req-8c984521-bc25-4c71-87c1-a8cf1f354684 service nova] Creating event network-vif-plugged:95cbc616-90a4-4fe0-8288-92d9ab2f32b3 for instance 5047389f-d232-432f-a459-bc4b023c358d on hv-cinder-85752 Sep 14 01:21:16.925328 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-5bf472c8-e705-47a3-8eee-62b6d77dbd9d req-8c984521-bc25-4c71-87c1-a8cf1f354684 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033568 Sep 14 01:21:16.926180 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 612/1212] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:21:17.650318 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-84633606-ed46-48af-95c5-663be152bf85 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:17.650928 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-84633606-ed46-48af-95c5-663be152bf85 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:17.657264 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84633606-ed46-48af-95c5-663be152bf85 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:17.657743 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84633606-ed46-48af-95c5-663be152bf85 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:17.658178 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84633606-ed46-48af-95c5-663be152bf85 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:17.658891 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84633606-ed46-48af-95c5-663be152bf85 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:17.659345 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84633606-ed46-48af-95c5-663be152bf85 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:17.659831 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-84633606-ed46-48af-95c5-663be152bf85 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:17.772382 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0434156c-57a0-4203-9ca9-09ed88666f5b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:17.773136 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0434156c-57a0-4203-9ca9-09ed88666f5b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:17.779659 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0434156c-57a0-4203-9ca9-09ed88666f5b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:17.780146 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0434156c-57a0-4203-9ca9-09ed88666f5b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:17.780580 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0434156c-57a0-4203-9ca9-09ed88666f5b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:17.781267 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0434156c-57a0-4203-9ca9-09ed88666f5b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:17.781717 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0434156c-57a0-4203-9ca9-09ed88666f5b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:17.782135 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0434156c-57a0-4203-9ca9-09ed88666f5b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:17.791749 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-84633606-ed46-48af-95c5-663be152bf85 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:17.799289 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-84633606-ed46-48af-95c5-663be152bf85 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1577 microversion: 2.1 time: 0.152825 Sep 14 01:21:17.799875 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 601/1213] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:17 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:17.913667 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-0434156c-57a0-4203-9ca9-09ed88666f5b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:17.921403 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0434156c-57a0-4203-9ca9-09ed88666f5b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1451 microversion: 2.1 time: 0.154347 Sep 14 01:21:17.921979 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 613/1214] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:17 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:21:17.944259 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8ee1a1dd-7330-4117-a2db-8aefa35fbf3b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:17.944860 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8ee1a1dd-7330-4117-a2db-8aefa35fbf3b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:17.950660 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8ee1a1dd-7330-4117-a2db-8aefa35fbf3b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:17.951130 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8ee1a1dd-7330-4117-a2db-8aefa35fbf3b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:17.951580 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8ee1a1dd-7330-4117-a2db-8aefa35fbf3b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:17.952253 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8ee1a1dd-7330-4117-a2db-8aefa35fbf3b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:17.952699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8ee1a1dd-7330-4117-a2db-8aefa35fbf3b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:17.953146 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8ee1a1dd-7330-4117-a2db-8aefa35fbf3b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:18.079669 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8ee1a1dd-7330-4117-a2db-8aefa35fbf3b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:18.087458 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8ee1a1dd-7330-4117-a2db-8aefa35fbf3b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1451 microversion: 2.1 time: 0.147360 Sep 14 01:21:18.088047 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 602/1215] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:17 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:18.822436 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-192fea22-44e6-4920-98a8-041d27aa01ce tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:21:18.823076 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-192fea22-44e6-4920-98a8-041d27aa01ce tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:21:18.825715 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:21:18.832185 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-192fea22-44e6-4920-98a8-041d27aa01ce tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:18.832682 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-192fea22-44e6-4920-98a8-041d27aa01ce tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:18.833126 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-192fea22-44e6-4920-98a8-041d27aa01ce tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:18.834021 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-192fea22-44e6-4920-98a8-041d27aa01ce tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:18.834610 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-192fea22-44e6-4920-98a8-041d27aa01ce tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:18.835101 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-192fea22-44e6-4920-98a8-041d27aa01ce tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:18.981869 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-192fea22-44e6-4920-98a8-041d27aa01ce tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:21:18.990658 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-192fea22-44e6-4920-98a8-041d27aa01ce tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1564 microversion: 2.1 time: 0.172051 Sep 14 01:21:18.991477 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 614/1216] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:21:18 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:21:19.662665 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-caaea92f-528a-4aee-a38f-83a30bc39c17 req-1e50ee0c-1a63-453d-8ae3-0e9ce79e3c8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b8a87a-9d23-48ed-ae9c-d765346329b7", "tag": "a5136ef8-e5ed-45d7-b1a8-5c87cacb64c2"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:21:19.668352 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:21:19.674306 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-caaea92f-528a-4aee-a38f-83a30bc39c17 req-1e50ee0c-1a63-453d-8ae3-0e9ce79e3c8c service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:21:19.674792 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-caaea92f-528a-4aee-a38f-83a30bc39c17 req-1e50ee0c-1a63-453d-8ae3-0e9ce79e3c8c service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:21:19.675220 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-caaea92f-528a-4aee-a38f-83a30bc39c17 req-1e50ee0c-1a63-453d-8ae3-0e9ce79e3c8c service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:21:19.688017 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-caaea92f-528a-4aee-a38f-83a30bc39c17 req-1e50ee0c-1a63-453d-8ae3-0e9ce79e3c8c service nova] Creating event network-changed:a5136ef8-e5ed-45d7-b1a8-5c87cacb64c2 for instance e0b8a87a-9d23-48ed-ae9c-d765346329b7 on hv-cinder-85752 Sep 14 01:21:19.692964 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-caaea92f-528a-4aee-a38f-83a30bc39c17 req-1e50ee0c-1a63-453d-8ae3-0e9ce79e3c8c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034682 Sep 14 01:21:19.693730 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 603/1217] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:22:50.549689 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:22:50.550613 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=82 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:22:50.552238 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7f306ce0-c037-4ea3-a880-2344cab43032] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 14 01:22:50.552932 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=70 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:22:50.554117 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:22:50.555878 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-df8a7805-a4c1-4841-b14d-f029ddc484ab tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:22:50.556314 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-df8a7805-a4c1-4841-b14d-f029ddc484ab tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:22:50.564963 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-df8a7805-a4c1-4841-b14d-f029ddc484ab tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:22:50.565456 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-df8a7805-a4c1-4841-b14d-f029ddc484ab tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:22:50.565891 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-df8a7805-a4c1-4841-b14d-f029ddc484ab tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:22:50.566593 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-df8a7805-a4c1-4841-b14d-f029ddc484ab tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:22:50.567191 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-df8a7805-a4c1-4841-b14d-f029ddc484ab tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:22:50.567644 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-df8a7805-a4c1-4841-b14d-f029ddc484ab tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:22:50.596140 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-df8a7805-a4c1-4841-b14d-f029ddc484ab tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Going to try to terminate instance {{(pid=120620) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:22:50.635637 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-5d01ea89-d16a-4f0b-be3c-9c6a8063cb6d req-0a2cc5ca-5032-4db7-900d-e6b6548a3966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5047389f-d232-432f-a459-bc4b023c358d", "tag": "95cbc616-90a4-4fe0-8288-92d9ab2f32b3"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:22:50.646739 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-5d01ea89-d16a-4f0b-be3c-9c6a8063cb6d req-0a2cc5ca-5032-4db7-900d-e6b6548a3966 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:22:50.647586 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-5d01ea89-d16a-4f0b-be3c-9c6a8063cb6d req-0a2cc5ca-5032-4db7-900d-e6b6548a3966 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:22:50.648024 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-5d01ea89-d16a-4f0b-be3c-9c6a8063cb6d req-0a2cc5ca-5032-4db7-900d-e6b6548a3966 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:22:50.661135 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-5d01ea89-d16a-4f0b-be3c-9c6a8063cb6d req-0a2cc5ca-5032-4db7-900d-e6b6548a3966 service nova] Creating event network-changed:95cbc616-90a4-4fe0-8288-92d9ab2f32b3 for instance 5047389f-d232-432f-a459-bc4b023c358d on hv-cinder-85752 Sep 14 01:22:50.667989 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-5d01ea89-d16a-4f0b-be3c-9c6a8063cb6d req-0a2cc5ca-5032-4db7-900d-e6b6548a3966 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117948 Sep 14 01:22:50.668579 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 604/1218] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:22:50.690960 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-df8a7805-a4c1-4841-b14d-f029ddc484ab tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 204 len: 0 microversion: 2.1 time: 0.142992 Sep 14 01:22:50.691763 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 615/1219] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:22:50 2022] DELETE /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 01:22:50.700508 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6d23165e-4860-468a-bc60-ff9bdc4743ec tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:22:50.701202 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-6d23165e-4860-468a-bc60-ff9bdc4743ec tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:22:50.707287 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d23165e-4860-468a-bc60-ff9bdc4743ec tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:22:50.707812 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d23165e-4860-468a-bc60-ff9bdc4743ec tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:22:50.708246 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d23165e-4860-468a-bc60-ff9bdc4743ec tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:22:50.708938 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d23165e-4860-468a-bc60-ff9bdc4743ec tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:22:50.709387 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d23165e-4860-468a-bc60-ff9bdc4743ec tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:22:50.709809 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-6d23165e-4860-468a-bc60-ff9bdc4743ec tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:22:50.859711 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-6d23165e-4860-468a-bc60-ff9bdc4743ec tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:22:50.867516 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6d23165e-4860-468a-bc60-ff9bdc4743ec tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1570 microversion: 2.1 time: 0.171174 Sep 14 01:22:50.868102 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 605/1220] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:22:50 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:22:51.908815 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a229df60-3d0c-4060-a0f0-e6e7c28172a9 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:22:51.909531 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a229df60-3d0c-4060-a0f0-e6e7c28172a9 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:22:51.916230 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a229df60-3d0c-4060-a0f0-e6e7c28172a9 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:22:51.916722 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a229df60-3d0c-4060-a0f0-e6e7c28172a9 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:22:51.917167 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a229df60-3d0c-4060-a0f0-e6e7c28172a9 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:22:51.917861 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a229df60-3d0c-4060-a0f0-e6e7c28172a9 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:22:51.918322 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a229df60-3d0c-4060-a0f0-e6e7c28172a9 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:22:51.918758 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a229df60-3d0c-4060-a0f0-e6e7c28172a9 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:22:52.060006 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a229df60-3d0c-4060-a0f0-e6e7c28172a9 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:22:52.067811 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a229df60-3d0c-4060-a0f0-e6e7c28172a9 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1570 microversion: 2.1 time: 0.163305 Sep 14 01:22:52.068372 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 616/1221] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:22:51 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:22:53.091855 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-5e64d22d-37a0-4909-b352-95b46e73d6a3 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:22:53.092741 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-5e64d22d-37a0-4909-b352-95b46e73d6a3 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:22:53.099427 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e64d22d-37a0-4909-b352-95b46e73d6a3 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:22:53.099952 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e64d22d-37a0-4909-b352-95b46e73d6a3 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:22:53.100390 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e64d22d-37a0-4909-b352-95b46e73d6a3 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:22:53.101090 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e64d22d-37a0-4909-b352-95b46e73d6a3 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:22:53.101548 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e64d22d-37a0-4909-b352-95b46e73d6a3 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:22:53.101998 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-5e64d22d-37a0-4909-b352-95b46e73d6a3 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:22:53.109888 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO oslo.messaging._drivers.impl_rabbit [-] [7f306ce0-c037-4ea3-a880-2344cab43032] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 43568. Sep 14 01:22:53.122127 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-6d3ae1f0-1ece-4119-8cea-9c30792b2812 req-8123b914-0e3a-4fa6-bc94-1c81bf676ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5047389f-d232-432f-a459-bc4b023c358d", "name": "network-vif-deleted", "tag": "95cbc616-90a4-4fe0-8288-92d9ab2f32b3"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:22:53.132303 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-6d3ae1f0-1ece-4119-8cea-9c30792b2812 req-8123b914-0e3a-4fa6-bc94-1c81bf676ad6 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:22:53.132778 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-6d3ae1f0-1ece-4119-8cea-9c30792b2812 req-8123b914-0e3a-4fa6-bc94-1c81bf676ad6 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:22:53.134136 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-6d3ae1f0-1ece-4119-8cea-9c30792b2812 req-8123b914-0e3a-4fa6-bc94-1c81bf676ad6 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:22:53.146886 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-6d3ae1f0-1ece-4119-8cea-9c30792b2812 req-8123b914-0e3a-4fa6-bc94-1c81bf676ad6 service nova] Creating event network-vif-deleted:95cbc616-90a4-4fe0-8288-92d9ab2f32b3 for instance 5047389f-d232-432f-a459-bc4b023c358d on hv-cinder-85752 Sep 14 01:22:53.152653 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-6d3ae1f0-1ece-4119-8cea-9c30792b2812 req-8123b914-0e3a-4fa6-bc94-1c81bf676ad6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035174 Sep 14 01:22:53.153583 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 617/1222] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:22:53.176428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-5e64d22d-37a0-4909-b352-95b46e73d6a3 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e8bab9899415c91d3b7122ab0a1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d80d1c2758499da66a93e91f9c1311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:22:53.184400 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-5e64d22d-37a0-4909-b352-95b46e73d6a3 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 200 len: 1383 microversion: 2.1 time: 0.096460 Sep 14 01:22:53.184981 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 606/1223] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:22:53 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 1383 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:22:54.208793 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-563416bf-0f64-4485-9473-3993c7840643 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:22:54.209518 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-563416bf-0f64-4485-9473-3993c7840643 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] [instance: 5047389f-d232-432f-a459-bc4b023c358d] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:22:54.215700 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-563416bf-0f64-4485-9473-3993c7840643 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:22:54.216189 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-563416bf-0f64-4485-9473-3993c7840643 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:22:54.216639 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-563416bf-0f64-4485-9473-3993c7840643 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:22:54.217321 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-563416bf-0f64-4485-9473-3993c7840643 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:22:54.217779 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-563416bf-0f64-4485-9473-3993c7840643 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:22:54.218206 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-563416bf-0f64-4485-9473-3993c7840643 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:22:54.231813 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-563416bf-0f64-4485-9473-3993c7840643 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] HTTP exception thrown: Instance 5047389f-d232-432f-a459-bc4b023c358d could not be found. Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-563416bf-0f64-4485-9473-3993c7840643 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Request method failure captured: Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d HTTP/1.1 Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISudng9xAgZzHDDkH4pXmfklSlLme1wyxfXRMadULSGNcNqPmwzChiWHr3dfshi9QEgKLChVub4zh4asuejIQpdI410s00xirxYjoFQqCE4jq_a-KFm1JwsiA3G85UYvld8OjO-SQASYktSMa0zigXhOZYvKdICjy3G83ZogZmuH28k Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: b2d80d1c2758499da66a93e91f9c1311 Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-TestShelveInstance-524242821 Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:22:54.233388 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:22:54.235170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2d80d1c2758499da66a93e91f9c1311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b2d80d1c2758499da66a93e91f9c1311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2d80d1c2758499da66a93e91f9c1311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b2d80d1c2758499da66a93e91f9c1311"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:22:54.235170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-TestShelveInstance-524242821 Sep 14 01:22:54.235170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: b2d80d1c2758499da66a93e91f9c1311 Sep 14 01:22:54.235170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-TestShelveInstance-524242821 Sep 14 01:22:54.235170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-TestShelveInstance-524242821-project Sep 14 01:22:54.235170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:22:54.235170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:22:54.235170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: 9e0e8bab9899415c91d3b7122ab0a1d0 Sep 14 01:22:54.235170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-TestShelveInstance-524242821-project Sep 14 01:22:54.235170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:22:54.235170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance 5047389f-d232-432f-a459-bc4b023c358d could not be found. Sep 14 01:22:54.235170 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': '5047389f-d232-432f-a459-bc4b023c358d'} Sep 14 01:22:54.236293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:22:54.236293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:22:54.236293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:22:54.236293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:22:54.236293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:22:54.236293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:22:54.236293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:22:54.236293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:22:54.236293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:22:54.236293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:22:54.236293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5047389f-d232-432f-a459-bc4b023c358d could not be found. Sep 14 01:22:54.236293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:22:54.236293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:22:54.236293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:22:54.236293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:22:54.236293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:22:54.236293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:22:54.236293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:22:54.236293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:22:54.236293 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:22:54.237999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:22:54.237999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:22:54.237999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:22:54.237999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:22:54.237999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:22:54.237999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:22:54.237999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:22:54.237999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5047389f-d232-432f-a459-bc4b023c358d could not be found. Sep 14 01:22:54.237999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:22:54.237999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:22:54.237999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:22:54.237999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:22:54.237999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:22:54.237999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:22:54.237999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:22:54.237999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:22:54.237999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5047389f-d232-432f-a459-bc4b023c358d could not be found. Sep 14 01:22:54.237999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:22:54.239576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-563416bf-0f64-4485-9473-3993c7840643 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Returning 404 to user: Instance 5047389f-d232-432f-a459-bc4b023c358d could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:22:54.239576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-563416bf-0f64-4485-9473-3993c7840643 tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d" status: 404 len: 111 microversion: 2.1 time: 0.030894 Sep 14 01:22:54.239576 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 618/1224] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:22:54 2022] GET /compute/v2.1/servers/5047389f-d232-432f-a459-bc4b023c358d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:22:54.392889 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-aa24cca7-5845-4cac-884c-2abf43f944dc tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] Calling method '.version_select at 0x7f5043d47700>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:22:54.415864 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-aa24cca7-5845-4cac-884c-2abf43f944dc tempest-TestShelveInstance-524242821 tempest-TestShelveInstance-524242821-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2052138769" status: 202 len: 0 microversion: 2.1 time: 0.027014 Sep 14 01:22:54.417523 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 607/1225] 10.222.0.42 () {58 vars in 1254 bytes} [Wed Sep 14 01:22:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2052138769 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 01:23:31.838765 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-0b94ca29-81ef-4f26-95de-7a7a7f2beb74 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-109513066", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-787735033", "security_groups": [{"name": "tempest-secgroup-smoke-166959226"}], "block_device_mapping_v2": [{"uuid": "962443cb-5097-40e2-9138-81baf19dfcb2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cef33139-f42c-4679-8281-e97f735186d9"}]}} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:23:31.849141 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:23:31.849952 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:23:31.956114 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.network.neutron [None req-0b94ca29-81ef-4f26-95de-7a7a7f2beb74 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] validate_networks() for [('cef33139-f42c-4679-8281-e97f735186d9', None, None, None, None, None)] {{(pid=120620) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 01:23:32.333066 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-0b94ca29-81ef-4f26-95de-7a7a7f2beb74 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Flavor limits 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 01:23:32.333478 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-0b94ca29-81ef-4f26-95de-7a7a7f2beb74 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Image limits 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 01:23:32.333944 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-0b94ca29-81ef-4f26-95de-7a7a7f2beb74 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Flavor pref 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 01:23:32.334346 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-0b94ca29-81ef-4f26-95de-7a7a7f2beb74 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Image pref 0:0:0 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 01:23:32.334751 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.virt.hardware [None req-0b94ca29-81ef-4f26-95de-7a7a7f2beb74 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 01:23:32.343695 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0b94ca29-81ef-4f26-95de-7a7a7f2beb74 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:32.344166 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0b94ca29-81ef-4f26-95de-7a7a7f2beb74 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:32.344592 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0b94ca29-81ef-4f26-95de-7a7a7f2beb74 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:32.345300 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0b94ca29-81ef-4f26-95de-7a7a7f2beb74 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:32.345746 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0b94ca29-81ef-4f26-95de-7a7a7f2beb74 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:32.346163 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-0b94ca29-81ef-4f26-95de-7a7a7f2beb74 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:32.363425 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-0b94ca29-81ef-4f26-95de-7a7a7f2beb74 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Getting quotas for project 6c0d5a6539764b53852b5741347734a8. Resources: {'cores', 'instances', 'ram'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 01:23:32.367441 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.quota [None req-0b94ca29-81ef-4f26-95de-7a7a7f2beb74 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Getting quotas for user b1494511685b47519f4aa0674009fbfc and project 6c0d5a6539764b53852b5741347734a8. Resources: {'cores', 'instances', 'ram'} {{(pid=120620) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 01:23:32.423502 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0b94ca29-81ef-4f26-95de-7a7a7f2beb74 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Going to run 1 instances... {{(pid=120620) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 01:23:32.425670 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-0b94ca29-81ef-4f26-95de-7a7a7f2beb74 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='962443cb-5097-40e2-9138-81baf19dfcb2',volume_size=None,volume_type=None)] {{(pid=120620) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 01:23:32.553838 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-0b94ca29-81ef-4f26-95de-7a7a7f2beb74 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.719568 Sep 14 01:23:32.554477 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 619/1226] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 01:23:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 01:23:32.563621 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=14 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:23:32.564359 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:23:32.568167 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8664c3b5-d1b5-4dd3-b682-c88bddea211d tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:23:32.568782 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8664c3b5-d1b5-4dd3-b682-c88bddea211d tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:23:32.630467 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8664c3b5-d1b5-4dd3-b682-c88bddea211d tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:23:32.637493 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8664c3b5-d1b5-4dd3-b682-c88bddea211d tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f" status: 200 len: 1093 microversion: 2.1 time: 0.075234 Sep 14 01:23:32.638073 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 608/1227] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:23:32 2022] GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:23:33.660903 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-bf514047-a25e-44a6-881b-c24a37a275fa tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:23:33.661684 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-bf514047-a25e-44a6-881b-c24a37a275fa tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:23:33.668526 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bf514047-a25e-44a6-881b-c24a37a275fa tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:33.669003 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bf514047-a25e-44a6-881b-c24a37a275fa tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:33.669444 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bf514047-a25e-44a6-881b-c24a37a275fa tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:33.670148 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bf514047-a25e-44a6-881b-c24a37a275fa tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:33.670613 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bf514047-a25e-44a6-881b-c24a37a275fa tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:33.671042 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bf514047-a25e-44a6-881b-c24a37a275fa tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:33.764061 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bf514047-a25e-44a6-881b-c24a37a275fa tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:23:33.772154 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-bf514047-a25e-44a6-881b-c24a37a275fa tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f" status: 200 len: 1199 microversion: 2.1 time: 0.115681 Sep 14 01:23:33.773188 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 620/1228] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:23:33 2022] GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f => generated 1199 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:23:34.797706 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-dd9d84e7-01db-4625-b80e-01023a6e1419 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:23:34.798326 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-dd9d84e7-01db-4625-b80e-01023a6e1419 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:23:34.804728 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dd9d84e7-01db-4625-b80e-01023a6e1419 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:34.805212 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dd9d84e7-01db-4625-b80e-01023a6e1419 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:34.805651 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dd9d84e7-01db-4625-b80e-01023a6e1419 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:34.806345 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dd9d84e7-01db-4625-b80e-01023a6e1419 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:34.807428 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dd9d84e7-01db-4625-b80e-01023a6e1419 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:34.807888 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-dd9d84e7-01db-4625-b80e-01023a6e1419 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:34.939748 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-dd9d84e7-01db-4625-b80e-01023a6e1419 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:23:34.947375 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-dd9d84e7-01db-4625-b80e-01023a6e1419 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f" status: 200 len: 1264 microversion: 2.1 time: 0.153791 Sep 14 01:23:34.947973 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 609/1229] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:23:34 2022] GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:23:35.349491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-09857f47-2c70-443f-9ed8-a3cdc519c774 req-f5da7b77-1ff0-4236-8a3d-2ce249011d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3d9774-7e87-4a89-83fd-a1db24ea955f", "tag": "e2c18982-0678-44d2-b8d6-9fcb81b9a123"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:23:35.361616 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-09857f47-2c70-443f-9ed8-a3cdc519c774 req-f5da7b77-1ff0-4236-8a3d-2ce249011d65 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:35.362225 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-09857f47-2c70-443f-9ed8-a3cdc519c774 req-f5da7b77-1ff0-4236-8a3d-2ce249011d65 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:35.362731 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-09857f47-2c70-443f-9ed8-a3cdc519c774 req-f5da7b77-1ff0-4236-8a3d-2ce249011d65 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:35.374518 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-09857f47-2c70-443f-9ed8-a3cdc519c774 req-f5da7b77-1ff0-4236-8a3d-2ce249011d65 service nova] Creating event network-changed:e2c18982-0678-44d2-b8d6-9fcb81b9a123 for instance 7c3d9774-7e87-4a89-83fd-a1db24ea955f on hv-cinder-85752 Sep 14 01:23:35.381080 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-09857f47-2c70-443f-9ed8-a3cdc519c774 req-f5da7b77-1ff0-4236-8a3d-2ce249011d65 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035735 Sep 14 01:23:35.381860 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 621/1230] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:23:35.969931 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-40d8fdbc-8426-49d2-9dd6-dfce47a0b46f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:23:35.970537 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-40d8fdbc-8426-49d2-9dd6-dfce47a0b46f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:23:35.977133 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-40d8fdbc-8426-49d2-9dd6-dfce47a0b46f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:35.977609 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-40d8fdbc-8426-49d2-9dd6-dfce47a0b46f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:35.978035 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-40d8fdbc-8426-49d2-9dd6-dfce47a0b46f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:35.979265 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-40d8fdbc-8426-49d2-9dd6-dfce47a0b46f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:35.979832 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-40d8fdbc-8426-49d2-9dd6-dfce47a0b46f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:35.980256 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-40d8fdbc-8426-49d2-9dd6-dfce47a0b46f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:36.114563 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-40d8fdbc-8426-49d2-9dd6-dfce47a0b46f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:23:36.122223 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-40d8fdbc-8426-49d2-9dd6-dfce47a0b46f tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f" status: 200 len: 1264 microversion: 2.1 time: 0.156248 Sep 14 01:23:36.122786 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 610/1231] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:23:35 2022] GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:23:37.145679 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-3c825f60-f636-4d6b-85c5-fa6932afaa54 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:23:37.146383 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-3c825f60-f636-4d6b-85c5-fa6932afaa54 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:23:37.153142 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3c825f60-f636-4d6b-85c5-fa6932afaa54 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:37.153626 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3c825f60-f636-4d6b-85c5-fa6932afaa54 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:37.154069 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3c825f60-f636-4d6b-85c5-fa6932afaa54 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:37.154788 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3c825f60-f636-4d6b-85c5-fa6932afaa54 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:37.155246 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3c825f60-f636-4d6b-85c5-fa6932afaa54 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:37.155709 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-3c825f60-f636-4d6b-85c5-fa6932afaa54 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:37.291857 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-3c825f60-f636-4d6b-85c5-fa6932afaa54 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:23:37.299574 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-3c825f60-f636-4d6b-85c5-fa6932afaa54 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f" status: 200 len: 1264 microversion: 2.1 time: 0.158108 Sep 14 01:23:37.300148 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 622/1232] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:23:37 2022] GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:23:38.322611 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-fc510d96-c063-4d5f-9e82-77376c51008b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:23:38.323463 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-fc510d96-c063-4d5f-9e82-77376c51008b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:23:38.329820 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fc510d96-c063-4d5f-9e82-77376c51008b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:38.330299 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fc510d96-c063-4d5f-9e82-77376c51008b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:38.330729 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fc510d96-c063-4d5f-9e82-77376c51008b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:38.331485 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fc510d96-c063-4d5f-9e82-77376c51008b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:38.331964 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fc510d96-c063-4d5f-9e82-77376c51008b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:38.332389 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-fc510d96-c063-4d5f-9e82-77376c51008b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:38.461965 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-fc510d96-c063-4d5f-9e82-77376c51008b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:23:38.469733 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-fc510d96-c063-4d5f-9e82-77376c51008b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f" status: 200 len: 1264 microversion: 2.1 time: 0.151583 Sep 14 01:23:38.470313 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 611/1233] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:23:38 2022] GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:23:39.492911 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-c0a9b188-af38-4c3b-8453-02190ee4a040 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:23:39.493527 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-c0a9b188-af38-4c3b-8453-02190ee4a040 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:23:39.500438 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c0a9b188-af38-4c3b-8453-02190ee4a040 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:39.500925 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c0a9b188-af38-4c3b-8453-02190ee4a040 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:39.501396 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c0a9b188-af38-4c3b-8453-02190ee4a040 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:39.502089 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c0a9b188-af38-4c3b-8453-02190ee4a040 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:39.502542 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c0a9b188-af38-4c3b-8453-02190ee4a040 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:39.502968 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-c0a9b188-af38-4c3b-8453-02190ee4a040 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:39.632723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-c0a9b188-af38-4c3b-8453-02190ee4a040 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:23:39.642099 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-c0a9b188-af38-4c3b-8453-02190ee4a040 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f" status: 200 len: 1264 microversion: 2.1 time: 0.152911 Sep 14 01:23:39.642654 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 623/1234] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:23:39 2022] GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:23:40.664400 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-e439e397-4494-48d7-bdaa-3a718d3ddaf4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:23:40.665020 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-e439e397-4494-48d7-bdaa-3a718d3ddaf4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:23:40.671545 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e439e397-4494-48d7-bdaa-3a718d3ddaf4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:40.672058 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e439e397-4494-48d7-bdaa-3a718d3ddaf4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:40.672498 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e439e397-4494-48d7-bdaa-3a718d3ddaf4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:40.673185 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e439e397-4494-48d7-bdaa-3a718d3ddaf4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:40.673646 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e439e397-4494-48d7-bdaa-3a718d3ddaf4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:40.674071 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-e439e397-4494-48d7-bdaa-3a718d3ddaf4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:40.804230 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-e439e397-4494-48d7-bdaa-3a718d3ddaf4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:23:40.812002 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-e439e397-4494-48d7-bdaa-3a718d3ddaf4 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f" status: 200 len: 1264 microversion: 2.1 time: 0.151468 Sep 14 01:23:40.812557 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 612/1235] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:23:40 2022] GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:23:41.834722 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-314b8a68-5a84-485a-a188-a780a23aedcb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:23:41.835329 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-314b8a68-5a84-485a-a188-a780a23aedcb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:23:41.842261 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-314b8a68-5a84-485a-a188-a780a23aedcb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:41.842736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-314b8a68-5a84-485a-a188-a780a23aedcb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:41.843167 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-314b8a68-5a84-485a-a188-a780a23aedcb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:41.843867 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-314b8a68-5a84-485a-a188-a780a23aedcb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:41.844316 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-314b8a68-5a84-485a-a188-a780a23aedcb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:41.844732 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-314b8a68-5a84-485a-a188-a780a23aedcb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:41.979352 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-314b8a68-5a84-485a-a188-a780a23aedcb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:23:41.987043 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-314b8a68-5a84-485a-a188-a780a23aedcb tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f" status: 200 len: 1264 microversion: 2.1 time: 0.156135 Sep 14 01:23:41.987631 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 624/1236] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:23:41 2022] GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:23:43.009925 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-98037c0c-c1a2-4d18-b3a6-256165c3c19a tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:23:43.010554 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-98037c0c-c1a2-4d18-b3a6-256165c3c19a tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:23:43.012939 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell0:SELECT=2 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:23:43.018533 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-98037c0c-c1a2-4d18-b3a6-256165c3c19a tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:43.019015 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-98037c0c-c1a2-4d18-b3a6-256165c3c19a tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:43.019454 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-98037c0c-c1a2-4d18-b3a6-256165c3c19a tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:43.020168 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-98037c0c-c1a2-4d18-b3a6-256165c3c19a tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:43.020625 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-98037c0c-c1a2-4d18-b3a6-256165c3c19a tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:43.021053 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-98037c0c-c1a2-4d18-b3a6-256165c3c19a tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:43.424638 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-98037c0c-c1a2-4d18-b3a6-256165c3c19a tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:23:43.432659 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-98037c0c-c1a2-4d18-b3a6-256165c3c19a tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f" status: 200 len: 1264 microversion: 2.1 time: 0.426589 Sep 14 01:23:43.433239 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 613/1237] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:23:43 2022] GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f => generated 1264 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:23:44.455967 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-2fcc4431-99a9-4198-b856-ffee9a44837a tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:23:44.456580 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-2fcc4431-99a9-4198-b856-ffee9a44837a tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:23:44.458497 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=2 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:23:44.459191 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell0:SELECT=6 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:23:44.466127 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2fcc4431-99a9-4198-b856-ffee9a44837a tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:44.466612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2fcc4431-99a9-4198-b856-ffee9a44837a tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:44.467129 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2fcc4431-99a9-4198-b856-ffee9a44837a tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:44.467767 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2fcc4431-99a9-4198-b856-ffee9a44837a tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:44.468226 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2fcc4431-99a9-4198-b856-ffee9a44837a tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:44.468652 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-2fcc4431-99a9-4198-b856-ffee9a44837a tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:44.614922 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-2fcc4431-99a9-4198-b856-ffee9a44837a tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:23:44.623151 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-2fcc4431-99a9-4198-b856-ffee9a44837a tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f" status: 200 len: 1264 microversion: 2.1 time: 0.171050 Sep 14 01:23:44.623748 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 625/1238] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:23:44 2022] GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:23:45.561183 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [req-533061ef-9664-4f4e-8112-4235fc30e31d req-8e1cf2e2-ed98-4ad8-8d1e-91ca1ce50068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3d9774-7e87-4a89-83fd-a1db24ea955f", "name": "network-vif-plugged", "status": "completed", "tag": "e2c18982-0678-44d2-b8d6-9fcb81b9a123"}]} {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:23:45.570385 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-533061ef-9664-4f4e-8112-4235fc30e31d req-8e1cf2e2-ed98-4ad8-8d1e-91ca1ce50068 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:45.570856 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-533061ef-9664-4f4e-8112-4235fc30e31d req-8e1cf2e2-ed98-4ad8-8d1e-91ca1ce50068 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:45.571278 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [req-533061ef-9664-4f4e-8112-4235fc30e31d req-8e1cf2e2-ed98-4ad8-8d1e-91ca1ce50068 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:45.582331 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.compute.server_external_events [req-533061ef-9664-4f4e-8112-4235fc30e31d req-8e1cf2e2-ed98-4ad8-8d1e-91ca1ce50068 service nova] Creating event network-vif-plugged:e2c18982-0678-44d2-b8d6-9fcb81b9a123 for instance 7c3d9774-7e87-4a89-83fd-a1db24ea955f on hv-cinder-85752 Sep 14 01:23:45.587741 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [req-533061ef-9664-4f4e-8112-4235fc30e31d req-8e1cf2e2-ed98-4ad8-8d1e-91ca1ce50068 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161314 Sep 14 01:23:45.588318 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 614/1239] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:23:45.647347 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-bccb91dc-2a7f-4ce0-9710-fb06f63a1579 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:23:45.647999 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-bccb91dc-2a7f-4ce0-9710-fb06f63a1579 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:23:45.654530 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bccb91dc-2a7f-4ce0-9710-fb06f63a1579 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:45.655026 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bccb91dc-2a7f-4ce0-9710-fb06f63a1579 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:45.655497 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bccb91dc-2a7f-4ce0-9710-fb06f63a1579 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:45.656252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bccb91dc-2a7f-4ce0-9710-fb06f63a1579 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:45.656716 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bccb91dc-2a7f-4ce0-9710-fb06f63a1579 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:45.657149 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-bccb91dc-2a7f-4ce0-9710-fb06f63a1579 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:45.806041 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-bccb91dc-2a7f-4ce0-9710-fb06f63a1579 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:23:45.815159 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-bccb91dc-2a7f-4ce0-9710-fb06f63a1579 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f" status: 200 len: 1264 microversion: 2.1 time: 0.171700 Sep 14 01:23:45.815762 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 626/1240] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:23:45 2022] GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:23:46.839864 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-8ed5ff64-c762-4ff6-862b-acf1125b7b06 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:23:46.840558 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-8ed5ff64-c762-4ff6-862b-acf1125b7b06 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:23:46.848569 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8ed5ff64-c762-4ff6-862b-acf1125b7b06 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:46.849056 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8ed5ff64-c762-4ff6-862b-acf1125b7b06 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:46.849491 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8ed5ff64-c762-4ff6-862b-acf1125b7b06 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:46.850184 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8ed5ff64-c762-4ff6-862b-acf1125b7b06 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:46.850633 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8ed5ff64-c762-4ff6-862b-acf1125b7b06 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:46.851054 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-8ed5ff64-c762-4ff6-862b-acf1125b7b06 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:46.984778 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-8ed5ff64-c762-4ff6-862b-acf1125b7b06 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:23:46.992676 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-8ed5ff64-c762-4ff6-862b-acf1125b7b06 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f" status: 200 len: 1264 microversion: 2.1 time: 0.157923 Sep 14 01:23:46.993251 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 615/1241] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:23:46 2022] GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:23:48.017142 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-a609fd44-6053-44dc-a2fc-929de445a02e tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:23:48.017768 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-a609fd44-6053-44dc-a2fc-929de445a02e tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:23:48.024450 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a609fd44-6053-44dc-a2fc-929de445a02e tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:48.025064 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a609fd44-6053-44dc-a2fc-929de445a02e tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:48.025705 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a609fd44-6053-44dc-a2fc-929de445a02e tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:48.026408 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a609fd44-6053-44dc-a2fc-929de445a02e tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:48.026871 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a609fd44-6053-44dc-a2fc-929de445a02e tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:48.027298 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-a609fd44-6053-44dc-a2fc-929de445a02e tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:48.157608 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-a609fd44-6053-44dc-a2fc-929de445a02e tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:23:48.165329 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-a609fd44-6053-44dc-a2fc-929de445a02e tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f" status: 200 len: 1451 microversion: 2.1 time: 0.152523 Sep 14 01:23:48.166585 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 627/1242] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:23:48 2022] GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:23:48.188246 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-c87324cc-2837-4b02-99be-be84f6722538 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:23:48.188868 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-c87324cc-2837-4b02-99be-be84f6722538 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:23:48.195535 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c87324cc-2837-4b02-99be-be84f6722538 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:48.196089 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c87324cc-2837-4b02-99be-be84f6722538 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:48.196707 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c87324cc-2837-4b02-99be-be84f6722538 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:48.197626 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c87324cc-2837-4b02-99be-be84f6722538 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:48.198196 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c87324cc-2837-4b02-99be-be84f6722538 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:48.198695 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-c87324cc-2837-4b02-99be-be84f6722538 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:48.332811 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-c87324cc-2837-4b02-99be-be84f6722538 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:23:48.340748 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-c87324cc-2837-4b02-99be-be84f6722538 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f" status: 200 len: 1451 microversion: 2.1 time: 0.156395 Sep 14 01:23:48.341312 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 616/1243] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:23:48 2022] GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:23:50.070074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-66ae4c3b-513e-4ec2-bb22-043a68d6be58 req-fb187653-ff68-46f5-9151-06f923b22ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3d9774-7e87-4a89-83fd-a1db24ea955f", "tag": "e2c18982-0678-44d2-b8d6-9fcb81b9a123"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:23:50.081452 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-66ae4c3b-513e-4ec2-bb22-043a68d6be58 req-fb187653-ff68-46f5-9151-06f923b22ceb service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:23:50.081933 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-66ae4c3b-513e-4ec2-bb22-043a68d6be58 req-fb187653-ff68-46f5-9151-06f923b22ceb service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:23:50.082385 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-66ae4c3b-513e-4ec2-bb22-043a68d6be58 req-fb187653-ff68-46f5-9151-06f923b22ceb service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:23:50.093634 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-66ae4c3b-513e-4ec2-bb22-043a68d6be58 req-fb187653-ff68-46f5-9151-06f923b22ceb service nova] Creating event network-changed:e2c18982-0678-44d2-b8d6-9fcb81b9a123 for instance 7c3d9774-7e87-4a89-83fd-a1db24ea955f on hv-cinder-85752 Sep 14 01:23:50.098587 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-66ae4c3b-513e-4ec2-bb22-043a68d6be58 req-fb187653-ff68-46f5-9151-06f923b22ceb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032200 Sep 14 01:23:50.099433 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 628/1244] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:25:39.690119 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_api:SELECT=20 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:25:39.690866 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG dbcounter [-] [120621] Writing DB stats nova_cell1:SELECT=44 {{(pid=120621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:25:39.692496 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 01:25:39.692660 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Wed Sep 14 01:25:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f (ip 10.222.0.42) !!! Sep 14 01:25:39.695705 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a0fbe376-67c5-4697-b243-06802adaa4b9] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 14 01:25:39.696595 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:25:39.697594 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG dbcounter [-] [120620] Writing DB stats nova_cell1:SELECT=48 {{(pid=120620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 01:25:39.699991 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-a5862a9c-4af7-4d79-b5d6-3816480c7a04 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:25:39.700506 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a5862a9c-4af7-4d79-b5d6-3816480c7a04 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:25:39.700647 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 01:25:39.700803 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Wed Sep 14 01:25:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Sep 14 01:25:39.709820 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a5862a9c-4af7-4d79-b5d6-3816480c7a04 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:39.710579 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a5862a9c-4af7-4d79-b5d6-3816480c7a04 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:39.711249 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a5862a9c-4af7-4d79-b5d6-3816480c7a04 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:39.712245 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a5862a9c-4af7-4d79-b5d6-3816480c7a04 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:39.712921 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a5862a9c-4af7-4d79-b5d6-3816480c7a04 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:39.713349 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-a5862a9c-4af7-4d79-b5d6-3816480c7a04 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:39.745904 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-a5862a9c-4af7-4d79-b5d6-3816480c7a04 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Going to try to terminate instance {{(pid=120621) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:25:39.806644 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-c9e60149-4c37-4a2e-909f-b7fe50ca40b1 req-e8f239cd-3511-4622-8c6d-705cca2faf23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3d9774-7e87-4a89-83fd-a1db24ea955f", "tag": "e2c18982-0678-44d2-b8d6-9fcb81b9a123"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:25:39.819695 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-c9e60149-4c37-4a2e-909f-b7fe50ca40b1 req-e8f239cd-3511-4622-8c6d-705cca2faf23 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:39.820508 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-c9e60149-4c37-4a2e-909f-b7fe50ca40b1 req-e8f239cd-3511-4622-8c6d-705cca2faf23 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:39.821619 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-c9e60149-4c37-4a2e-909f-b7fe50ca40b1 req-e8f239cd-3511-4622-8c6d-705cca2faf23 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:39.835672 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-c9e60149-4c37-4a2e-909f-b7fe50ca40b1 req-e8f239cd-3511-4622-8c6d-705cca2faf23 service nova] Creating event network-changed:e2c18982-0678-44d2-b8d6-9fcb81b9a123 for instance 7c3d9774-7e87-4a89-83fd-a1db24ea955f on hv-cinder-85752 Sep 14 01:25:39.836329 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-a5862a9c-4af7-4d79-b5d6-3816480c7a04 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f" status: 204 len: 0 microversion: 2.1 time: 0.147786 Sep 14 01:25:39.840737 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 617/1245] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:25:39 2022] DELETE /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 01:25:39.845242 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-c9e60149-4c37-4a2e-909f-b7fe50ca40b1 req-e8f239cd-3511-4622-8c6d-705cca2faf23 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153893 Sep 14 01:25:39.846142 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 629/1246] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:25:39.846618 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-50c33ebc-3a0f-4291-8581-89df7ea9c4ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:25:39.847327 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-50c33ebc-3a0f-4291-8581-89df7ea9c4ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:25:39.853721 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-50c33ebc-3a0f-4291-8581-89df7ea9c4ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:39.854766 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-50c33ebc-3a0f-4291-8581-89df7ea9c4ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:39.855212 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-50c33ebc-3a0f-4291-8581-89df7ea9c4ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:39.855946 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-50c33ebc-3a0f-4291-8581-89df7ea9c4ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:39.856408 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-50c33ebc-3a0f-4291-8581-89df7ea9c4ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:39.856841 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-50c33ebc-3a0f-4291-8581-89df7ea9c4ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:39.992615 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-50c33ebc-3a0f-4291-8581-89df7ea9c4ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:25:40.001390 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-50c33ebc-3a0f-4291-8581-89df7ea9c4ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f" status: 200 len: 1576 microversion: 2.1 time: 0.159249 Sep 14 01:25:40.001967 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 618/1247] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:25:39 2022] GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:25:41.025310 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-17d15e13-79cb-4ebd-b217-9fb775bc5eb5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:25:41.026081 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-17d15e13-79cb-4ebd-b217-9fb775bc5eb5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:25:41.034675 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17d15e13-79cb-4ebd-b217-9fb775bc5eb5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:41.035175 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17d15e13-79cb-4ebd-b217-9fb775bc5eb5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:41.035651 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17d15e13-79cb-4ebd-b217-9fb775bc5eb5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:41.036358 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17d15e13-79cb-4ebd-b217-9fb775bc5eb5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:41.036819 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17d15e13-79cb-4ebd-b217-9fb775bc5eb5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:41.037250 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-17d15e13-79cb-4ebd-b217-9fb775bc5eb5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:41.044222 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO oslo.messaging._drivers.impl_rabbit [-] [a0fbe376-67c5-4697-b243-06802adaa4b9] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 43782. Sep 14 01:25:41.209877 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-17d15e13-79cb-4ebd-b217-9fb775bc5eb5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:25:41.217678 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-17d15e13-79cb-4ebd-b217-9fb775bc5eb5 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f" status: 200 len: 1576 microversion: 2.1 time: 0.196594 Sep 14 01:25:41.218250 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 630/1248] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:25:41 2022] GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f => generated 1576 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 01:25:42.242278 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-0cf34a56-4c58-4c18-9a28-5ccaf47da003 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:25:42.243104 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-0cf34a56-4c58-4c18-9a28-5ccaf47da003 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:25:42.250125 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0cf34a56-4c58-4c18-9a28-5ccaf47da003 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:42.250679 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0cf34a56-4c58-4c18-9a28-5ccaf47da003 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:42.251184 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0cf34a56-4c58-4c18-9a28-5ccaf47da003 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:42.251984 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0cf34a56-4c58-4c18-9a28-5ccaf47da003 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:42.252510 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0cf34a56-4c58-4c18-9a28-5ccaf47da003 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:42.253042 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-0cf34a56-4c58-4c18-9a28-5ccaf47da003 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:42.270870 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-57f4ad30-cc8a-43d7-87c3-b5d15f649aca req-c114a3ee-4c80-40ce-a1f6-758fb1d8a7fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3d9774-7e87-4a89-83fd-a1db24ea955f", "name": "network-vif-deleted", "tag": "e2c18982-0678-44d2-b8d6-9fcb81b9a123"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:25:42.283219 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-57f4ad30-cc8a-43d7-87c3-b5d15f649aca req-c114a3ee-4c80-40ce-a1f6-758fb1d8a7fc service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:42.283736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-57f4ad30-cc8a-43d7-87c3-b5d15f649aca req-c114a3ee-4c80-40ce-a1f6-758fb1d8a7fc service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:42.284173 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-57f4ad30-cc8a-43d7-87c3-b5d15f649aca req-c114a3ee-4c80-40ce-a1f6-758fb1d8a7fc service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:42.296180 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-57f4ad30-cc8a-43d7-87c3-b5d15f649aca req-c114a3ee-4c80-40ce-a1f6-758fb1d8a7fc service nova] Creating event network-vif-deleted:e2c18982-0678-44d2-b8d6-9fcb81b9a123 for instance 7c3d9774-7e87-4a89-83fd-a1db24ea955f on hv-cinder-85752 Sep 14 01:25:42.301560 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-57f4ad30-cc8a-43d7-87c3-b5d15f649aca req-c114a3ee-4c80-40ce-a1f6-758fb1d8a7fc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034484 Sep 14 01:25:42.302805 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 631/1249] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 01:25:42.325796 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-0cf34a56-4c58-4c18-9a28-5ccaf47da003 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:25:42.334132 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-0cf34a56-4c58-4c18-9a28-5ccaf47da003 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f" status: 200 len: 1390 microversion: 2.1 time: 0.096231 Sep 14 01:25:42.334715 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 619/1250] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:25:42 2022] GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f => generated 1390 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:25:43.359063 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-adb15a0e-2b3b-479f-be67-853d186596ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:25:43.359790 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-adb15a0e-2b3b-479f-be67-853d186596ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: 7c3d9774-7e87-4a89-83fd-a1db24ea955f] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:25:43.365887 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-adb15a0e-2b3b-479f-be67-853d186596ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:43.366370 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-adb15a0e-2b3b-479f-be67-853d186596ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:43.366811 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-adb15a0e-2b3b-479f-be67-853d186596ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:43.367491 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-adb15a0e-2b3b-479f-be67-853d186596ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:43.367970 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-adb15a0e-2b3b-479f-be67-853d186596ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:43.368399 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-adb15a0e-2b3b-479f-be67-853d186596ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:43.381551 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-adb15a0e-2b3b-479f-be67-853d186596ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] HTTP exception thrown: Instance 7c3d9774-7e87-4a89-83fd-a1db24ea955f could not be found. Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-adb15a0e-2b3b-479f-be67-853d186596ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Request method failure captured: Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f HTTP/1.1 Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISufKo3aEOcjstYtTUvPgVsgJiKFjYP48TbC8t41inG0h0GWblYl-ma5xl95BIeVOgICqWJhmPFpsYQK_aMR1QST8oppf05IFqDc2ZuO5PFYpv0nhv_qvQT3pY9kRvKy5X8x9QZiG8WPLPsbSb0nGTyb3zJ_scOH7tWAequud3QCpTU Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 6c0d5a6539764b53852b5741347734a8 Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-TestVolumeBootPattern-1448431353 Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:25:43.383074 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:25:43.384923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6c0d5a6539764b53852b5741347734a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6c0d5a6539764b53852b5741347734a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6c0d5a6539764b53852b5741347734a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6c0d5a6539764b53852b5741347734a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:25:43.384923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-TestVolumeBootPattern-1448431353 Sep 14 01:25:43.384923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 6c0d5a6539764b53852b5741347734a8 Sep 14 01:25:43.384923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-TestVolumeBootPattern-1448431353 Sep 14 01:25:43.384923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-TestVolumeBootPattern-1448431353-project Sep 14 01:25:43.384923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:25:43.384923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:25:43.384923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: b1494511685b47519f4aa0674009fbfc Sep 14 01:25:43.384923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-TestVolumeBootPattern-1448431353-project Sep 14 01:25:43.384923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:25:43.384923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance 7c3d9774-7e87-4a89-83fd-a1db24ea955f could not be found. Sep 14 01:25:43.384923 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': '7c3d9774-7e87-4a89-83fd-a1db24ea955f'} Sep 14 01:25:43.386165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:25:43.386165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:25:43.386165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:25:43.386165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:25:43.386165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:25:43.386165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:25:43.386165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:25:43.386165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:25:43.386165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:25:43.386165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:25:43.386165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c3d9774-7e87-4a89-83fd-a1db24ea955f could not be found. Sep 14 01:25:43.386165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:25:43.386165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:25:43.386165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:25:43.386165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:25:43.386165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:25:43.386165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:25:43.386165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:25:43.386165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:25:43.386165 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:25:43.387784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:25:43.387784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:25:43.387784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:25:43.387784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:25:43.387784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:25:43.387784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:25:43.387784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:25:43.387784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c3d9774-7e87-4a89-83fd-a1db24ea955f could not be found. Sep 14 01:25:43.387784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:25:43.387784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:25:43.387784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:25:43.387784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:25:43.387784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:25:43.387784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:25:43.387784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:25:43.387784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:25:43.387784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c3d9774-7e87-4a89-83fd-a1db24ea955f could not be found. Sep 14 01:25:43.387784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:25:43.389252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-adb15a0e-2b3b-479f-be67-853d186596ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Returning 404 to user: Instance 7c3d9774-7e87-4a89-83fd-a1db24ea955f could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:25:43.389252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-adb15a0e-2b3b-479f-be67-853d186596ea tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f" status: 404 len: 111 microversion: 2.1 time: 0.030941 Sep 14 01:25:43.389252 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 632/1251] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:25:43 2022] GET /compute/v2.1/servers/7c3d9774-7e87-4a89-83fd-a1db24ea955f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:25:46.454512 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-52e14002-77e6-450d-a89a-77a7793af8c0 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:25:46.459797 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-6fc2b9b2-72ef-40f9-93b5-656c44310101 req-1bbcd8f2-7fc3-424e-9fa9-7f61afa73d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b8a87a-9d23-48ed-ae9c-d765346329b7", "tag": "a5136ef8-e5ed-45d7-b1a8-5c87cacb64c2"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:25:46.466800 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-52e14002-77e6-450d-a89a-77a7793af8c0 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:25:46.473246 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52e14002-77e6-450d-a89a-77a7793af8c0 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:46.477167 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-6fc2b9b2-72ef-40f9-93b5-656c44310101 req-1bbcd8f2-7fc3-424e-9fa9-7f61afa73d88 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:46.477651 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-6fc2b9b2-72ef-40f9-93b5-656c44310101 req-1bbcd8f2-7fc3-424e-9fa9-7f61afa73d88 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:46.478082 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-6fc2b9b2-72ef-40f9-93b5-656c44310101 req-1bbcd8f2-7fc3-424e-9fa9-7f61afa73d88 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:46.480639 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52e14002-77e6-450d-a89a-77a7793af8c0 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:46.481177 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52e14002-77e6-450d-a89a-77a7793af8c0 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:46.481980 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52e14002-77e6-450d-a89a-77a7793af8c0 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:46.482453 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52e14002-77e6-450d-a89a-77a7793af8c0 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:46.482881 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52e14002-77e6-450d-a89a-77a7793af8c0 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:46.499264 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-6fc2b9b2-72ef-40f9-93b5-656c44310101 req-1bbcd8f2-7fc3-424e-9fa9-7f61afa73d88 service nova] Creating event network-changed:a5136ef8-e5ed-45d7-b1a8-5c87cacb64c2 for instance e0b8a87a-9d23-48ed-ae9c-d765346329b7 on hv-cinder-85752 Sep 14 01:25:46.505309 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-6fc2b9b2-72ef-40f9-93b5-656c44310101 req-1bbcd8f2-7fc3-424e-9fa9-7f61afa73d88 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048784 Sep 14 01:25:46.506087 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 633/1252] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:25:46.511963 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-52e14002-77e6-450d-a89a-77a7793af8c0 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Going to try to terminate instance {{(pid=120621) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 01:25:46.604562 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-52e14002-77e6-450d-a89a-77a7793af8c0 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 204 len: 0 microversion: 2.1 time: 0.152929 Sep 14 01:25:46.605513 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 620/1253] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:25:46 2022] DELETE /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 01:25:46.614430 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-9f3c4a16-6a9a-441c-852c-74857567039b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:25:46.615137 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-9f3c4a16-6a9a-441c-852c-74857567039b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:25:46.621335 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9f3c4a16-6a9a-441c-852c-74857567039b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:46.621817 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9f3c4a16-6a9a-441c-852c-74857567039b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:46.622255 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9f3c4a16-6a9a-441c-852c-74857567039b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:46.622956 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9f3c4a16-6a9a-441c-852c-74857567039b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:46.623414 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9f3c4a16-6a9a-441c-852c-74857567039b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:46.623924 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-9f3c4a16-6a9a-441c-852c-74857567039b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:46.757784 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.policy [None req-9f3c4a16-6a9a-441c-852c-74857567039b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120620) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:25:46.767256 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-9f3c4a16-6a9a-441c-852c-74857567039b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1575 microversion: 2.1 time: 0.157449 Sep 14 01:25:46.768185 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 634/1254] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:25:46 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:25:47.790726 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-bbfb4014-6aad-4c58-ab71-bae7ce1ec730 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:25:47.791455 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-bbfb4014-6aad-4c58-ab71-bae7ce1ec730 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:25:47.798251 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bbfb4014-6aad-4c58-ab71-bae7ce1ec730 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:47.798735 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bbfb4014-6aad-4c58-ab71-bae7ce1ec730 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:47.799173 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bbfb4014-6aad-4c58-ab71-bae7ce1ec730 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:47.799926 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bbfb4014-6aad-4c58-ab71-bae7ce1ec730 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:47.800380 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bbfb4014-6aad-4c58-ab71-bae7ce1ec730 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:47.800799 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-bbfb4014-6aad-4c58-ab71-bae7ce1ec730 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:47.972016 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-bbfb4014-6aad-4c58-ab71-bae7ce1ec730 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:25:47.980045 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-bbfb4014-6aad-4c58-ab71-bae7ce1ec730 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1575 microversion: 2.1 time: 0.193048 Sep 14 01:25:47.980699 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 621/1255] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:25:47 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1575 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:25:48.829529 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [req-61e78e0c-24a9-4996-bf1b-cae9fdd8cc03 req-ddd03745-832b-4b74-aeca-766972f5e360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b8a87a-9d23-48ed-ae9c-d765346329b7", "name": "network-vif-deleted", "tag": "a5136ef8-e5ed-45d7-b1a8-5c87cacb64c2"}]} {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 01:25:48.841311 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-61e78e0c-24a9-4996-bf1b-cae9fdd8cc03 req-ddd03745-832b-4b74-aeca-766972f5e360 service nova] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:48.842044 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-61e78e0c-24a9-4996-bf1b-cae9fdd8cc03 req-ddd03745-832b-4b74-aeca-766972f5e360 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:48.843728 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [req-61e78e0c-24a9-4996-bf1b-cae9fdd8cc03 req-ddd03745-832b-4b74-aeca-766972f5e360 service nova] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:48.855988 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.compute.server_external_events [req-61e78e0c-24a9-4996-bf1b-cae9fdd8cc03 req-ddd03745-832b-4b74-aeca-766972f5e360 service nova] Creating event network-vif-deleted:a5136ef8-e5ed-45d7-b1a8-5c87cacb64c2 for instance e0b8a87a-9d23-48ed-ae9c-d765346329b7 on hv-cinder-85752 Sep 14 01:25:48.860709 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [req-61e78e0c-24a9-4996-bf1b-cae9fdd8cc03 req-ddd03745-832b-4b74-aeca-766972f5e360 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035360 Sep 14 01:25:48.861561 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 635/1256] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 01:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 01:25:49.004772 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-af42725a-5bc1-4c44-aed3-791e70b3a440 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:25:49.005341 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-af42725a-5bc1-4c44-aed3-791e70b3a440 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:25:49.011956 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-af42725a-5bc1-4c44-aed3-791e70b3a440 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:49.012449 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-af42725a-5bc1-4c44-aed3-791e70b3a440 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:49.012898 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-af42725a-5bc1-4c44-aed3-791e70b3a440 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:49.013598 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-af42725a-5bc1-4c44-aed3-791e70b3a440 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:49.014058 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-af42725a-5bc1-4c44-aed3-791e70b3a440 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:49.014488 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-af42725a-5bc1-4c44-aed3-791e70b3a440 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:49.093041 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.policy [None req-af42725a-5bc1-4c44-aed3-791e70b3a440 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1494511685b47519f4aa0674009fbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d5a6539764b53852b5741347734a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120621) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 01:25:49.103185 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-af42725a-5bc1-4c44-aed3-791e70b3a440 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 200 len: 1224 microversion: 2.1 time: 0.102134 Sep 14 01:25:49.103924 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 622/1257] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:25:48 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 01:25:50.133878 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-f05139d6-f908-48be-baa1-2e80493c6150 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:25:50.134578 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-f05139d6-f908-48be-baa1-2e80493c6150 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: e0b8a87a-9d23-48ed-ae9c-d765346329b7] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:25:50.141859 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f05139d6-f908-48be-baa1-2e80493c6150 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:50.142339 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f05139d6-f908-48be-baa1-2e80493c6150 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:50.142774 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f05139d6-f908-48be-baa1-2e80493c6150 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:50.143465 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f05139d6-f908-48be-baa1-2e80493c6150 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:50.143946 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f05139d6-f908-48be-baa1-2e80493c6150 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:50.144372 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-f05139d6-f908-48be-baa1-2e80493c6150 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:50.157452 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-f05139d6-f908-48be-baa1-2e80493c6150 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] HTTP exception thrown: Instance e0b8a87a-9d23-48ed-ae9c-d765346329b7 could not be found. Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-f05139d6-f908-48be-baa1-2e80493c6150 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Request method failure captured: Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 HTTP/1.1 Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISufKo3aEOcjstYtTUvPgVsgJiKFjYP48TbC8t41inG0h0GWblYl-ma5xl95BIeVOgICqWJhmPFpsYQK_aMR1QST8oppf05IFqDc2ZuO5PFYpv0nhv_qvQT3pY9kRvKy5X8x9QZiG8WPLPsbSb0nGTyb3zJ_scOH7tWAequud3QCpTU Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 6c0d5a6539764b53852b5741347734a8 Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-TestVolumeBootPattern-1448431353 Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:25:50.159049 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:25:50.160915 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6c0d5a6539764b53852b5741347734a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6c0d5a6539764b53852b5741347734a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6c0d5a6539764b53852b5741347734a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6c0d5a6539764b53852b5741347734a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:25:50.160915 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-TestVolumeBootPattern-1448431353 Sep 14 01:25:50.160915 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 6c0d5a6539764b53852b5741347734a8 Sep 14 01:25:50.160915 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-TestVolumeBootPattern-1448431353 Sep 14 01:25:50.160915 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-TestVolumeBootPattern-1448431353-project Sep 14 01:25:50.160915 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:25:50.160915 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:25:50.160915 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: b1494511685b47519f4aa0674009fbfc Sep 14 01:25:50.160915 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-TestVolumeBootPattern-1448431353-project Sep 14 01:25:50.160915 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:25:50.160915 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance e0b8a87a-9d23-48ed-ae9c-d765346329b7 could not be found. Sep 14 01:25:50.160915 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': 'e0b8a87a-9d23-48ed-ae9c-d765346329b7'} Sep 14 01:25:50.162117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:25:50.162117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:25:50.162117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:25:50.162117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:25:50.162117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:25:50.162117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:25:50.162117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:25:50.162117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:25:50.162117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:25:50.162117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:25:50.162117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0b8a87a-9d23-48ed-ae9c-d765346329b7 could not be found. Sep 14 01:25:50.162117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:25:50.162117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:25:50.162117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:25:50.162117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:25:50.162117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:25:50.162117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:25:50.162117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:25:50.162117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:25:50.162117 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:25:50.163736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:25:50.163736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:25:50.163736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:25:50.163736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:25:50.163736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:25:50.163736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:25:50.163736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:25:50.163736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0b8a87a-9d23-48ed-ae9c-d765346329b7 could not be found. Sep 14 01:25:50.163736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:25:50.163736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:25:50.163736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:25:50.163736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:25:50.163736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:25:50.163736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:25:50.163736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:25:50.163736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:25:50.163736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0b8a87a-9d23-48ed-ae9c-d765346329b7 could not be found. Sep 14 01:25:50.163736 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:25:50.165348 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-f05139d6-f908-48be-baa1-2e80493c6150 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Returning 404 to user: Instance e0b8a87a-9d23-48ed-ae9c-d765346329b7 could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:25:50.165348 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-f05139d6-f908-48be-baa1-2e80493c6150 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7" status: 404 len: 111 microversion: 2.1 time: 0.031408 Sep 14 01:25:50.165348 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 636/1258] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:25:50 2022] GET /compute/v2.1/servers/e0b8a87a-9d23-48ed-ae9c-d765346329b7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:25:50.598813 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-52f1c6cf-83b4-41d7-9477-0577a0713a1b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:25:50.599330 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.compute.api [None req-52f1c6cf-83b4-41d7-9477-0577a0713a1b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120621) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:25:50.606509 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52f1c6cf-83b4-41d7-9477-0577a0713a1b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:50.606991 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52f1c6cf-83b4-41d7-9477-0577a0713a1b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:50.607434 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52f1c6cf-83b4-41d7-9477-0577a0713a1b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:50.608142 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52f1c6cf-83b4-41d7-9477-0577a0713a1b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:50.608597 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52f1c6cf-83b4-41d7-9477-0577a0713a1b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:50.609022 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG oslo_concurrency.lockutils [None req-52f1c6cf-83b4-41d7-9477-0577a0713a1b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:50.622174 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.wsgi [None req-52f1c6cf-83b4-41d7-9477-0577a0713a1b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] HTTP exception thrown: Instance b27979fc-e36a-4644-9d51-55c6c105c7a9 could not be found. Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-52f1c6cf-83b4-41d7-9477-0577a0713a1b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Request method failure captured: Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: request: DELETE /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 HTTP/1.1 Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept: application/json Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Accept-Encoding: identity Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Connection: close Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Length: 0 Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Content-Type: application/json Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Host: 10.222.0.42 Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: Openstack-System-Scope: None Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: User-Agent: python-urllib3/1.26.12 Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Auth-Token: gAAAAABjISufKo3aEOcjstYtTUvPgVsgJiKFjYP48TbC8t41inG0h0GWblYl-ma5xl95BIeVOgICqWJhmPFpsYQK_aMR1QST8oppf05IFqDc2ZuO5PFYpv0nhv_qvQT3pY9kRvKy5X8x9QZiG8WPLPsbSb0nGTyb3zJ_scOH7tWAequud3QCpTU Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Id: None Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Domain-Name: None Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Identity-Status: Confirmed Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Is-Admin-Project: True Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Id: default Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Domain-Name: Default Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Id: 6c0d5a6539764b53852b5741347734a8 Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Project-Name: tempest-TestVolumeBootPattern-1448431353 Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Role: reader,member Sep 14 01:25:50.623920 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Roles: reader,member Sep 14 01:25:50.625619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6c0d5a6539764b53852b5741347734a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6c0d5a6539764b53852b5741347734a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6c0d5a6539764b53852b5741347734a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6c0d5a6539764b53852b5741347734a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:25:50.625619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant: tempest-TestVolumeBootPattern-1448431353 Sep 14 01:25:50.625619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Id: 6c0d5a6539764b53852b5741347734a8 Sep 14 01:25:50.625619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-Tenant-Name: tempest-TestVolumeBootPattern-1448431353 Sep 14 01:25:50.625619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User: tempest-TestVolumeBootPattern-1448431353-project Sep 14 01:25:50.625619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Id: default Sep 14 01:25:50.625619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Domain-Name: Default Sep 14 01:25:50.625619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Id: b1494511685b47519f4aa0674009fbfc Sep 14 01:25:50.625619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: X-User-Name: tempest-TestVolumeBootPattern-1448431353-project Sep 14 01:25:50.625619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: method: > Sep 14 01:25:50.625619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: exception: Instance b27979fc-e36a-4644-9d51-55c6c105c7a9 could not be found. Sep 14 01:25:50.625619 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: action_args: {'id': 'b27979fc-e36a-4644-9d51-55c6c105c7a9'} Sep 14 01:25:50.626670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:25:50.626670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:25:50.626670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:25:50.626670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:25:50.626670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:25:50.626670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:25:50.626670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:25:50.626670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:25:50.626670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:25:50.626670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:25:50.626670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27979fc-e36a-4644-9d51-55c6c105c7a9 could not be found. Sep 14 01:25:50.626670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:25:50.626670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:25:50.626670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:25:50.626670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:25:50.626670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:25:50.626670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:25:50.626670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:25:50.626670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:25:50.626670 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:25:50.628103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:25:50.628103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 01:25:50.628103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 01:25:50.628103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 01:25:50.628103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 01:25:50.628103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:25:50.628103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:25:50.628103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:25:50.628103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:25:50.628103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27979fc-e36a-4644-9d51-55c6c105c7a9 could not be found. Sep 14 01:25:50.628103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:25:50.628103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:25:50.628103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:25:50.628103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:25:50.628103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:25:50.628103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:25:50.628103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:25:50.628103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:25:50.628103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27979fc-e36a-4644-9d51-55c6c105c7a9 could not be found. Sep 14 01:25:50.628103 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR nova.api.openstack.wsgi Sep 14 01:25:50.629715 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-52f1c6cf-83b4-41d7-9477-0577a0713a1b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Returning 404 to user: Instance b27979fc-e36a-4644-9d51-55c6c105c7a9 could not be found. {{(pid=120621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:25:50.629715 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-52f1c6cf-83b4-41d7-9477-0577a0713a1b tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 404 len: 111 microversion: 2.1 time: 0.030432 Sep 14 01:25:50.629715 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 623/1259] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 01:25:50 2022] DELETE /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:25:50.634022 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6d7824b2-36c4-4ea4-b106-0aa2d2825145 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '>' {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:25:50.634637 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.compute.api [None req-6d7824b2-36c4-4ea4-b106-0aa2d2825145 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [instance: b27979fc-e36a-4644-9d51-55c6c105c7a9] Fetching instance by UUID {{(pid=120620) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 01:25:50.640905 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6d7824b2-36c4-4ea4-b106-0aa2d2825145 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:50.641382 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6d7824b2-36c4-4ea4-b106-0aa2d2825145 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:50.641816 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6d7824b2-36c4-4ea4-b106-0aa2d2825145 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:50.642505 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6d7824b2-36c4-4ea4-b106-0aa2d2825145 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Acquiring lock "74d3b739-38e2-4172-876a-396cfbc13f8f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 01:25:50.642962 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6d7824b2-36c4-4ea4-b106-0aa2d2825145 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 01:25:50.643383 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG oslo_concurrency.lockutils [None req-6d7824b2-36c4-4ea4-b106-0aa2d2825145 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Lock "74d3b739-38e2-4172-876a-396cfbc13f8f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 01:25:50.657005 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.wsgi [None req-6d7824b2-36c4-4ea4-b106-0aa2d2825145 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] HTTP exception thrown: Instance b27979fc-e36a-4644-9d51-55c6c105c7a9 could not be found. Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6d7824b2-36c4-4ea4-b106-0aa2d2825145 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Request method failure captured: Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: request: GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 HTTP/1.1 Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept: application/json Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Accept-Encoding: identity Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Connection: close Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Length: 0 Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Content-Type: application/json Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Host: 10.222.0.42 Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: Openstack-System-Scope: None Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: User-Agent: python-urllib3/1.26.12 Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Auth-Token: gAAAAABjISufKo3aEOcjstYtTUvPgVsgJiKFjYP48TbC8t41inG0h0GWblYl-ma5xl95BIeVOgICqWJhmPFpsYQK_aMR1QST8oppf05IFqDc2ZuO5PFYpv0nhv_qvQT3pY9kRvKy5X8x9QZiG8WPLPsbSb0nGTyb3zJ_scOH7tWAequud3QCpTU Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Id: None Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Domain-Name: None Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Identity-Status: Confirmed Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Is-Admin-Project: True Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Id: default Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Domain-Name: Default Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Id: 6c0d5a6539764b53852b5741347734a8 Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Project-Name: tempest-TestVolumeBootPattern-1448431353 Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Role: reader,member Sep 14 01:25:50.658723 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Roles: reader,member Sep 14 01:25:50.660505 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6c0d5a6539764b53852b5741347734a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6c0d5a6539764b53852b5741347734a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6c0d5a6539764b53852b5741347734a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6c0d5a6539764b53852b5741347734a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Sep 14 01:25:50.660505 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant: tempest-TestVolumeBootPattern-1448431353 Sep 14 01:25:50.660505 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Id: 6c0d5a6539764b53852b5741347734a8 Sep 14 01:25:50.660505 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-Tenant-Name: tempest-TestVolumeBootPattern-1448431353 Sep 14 01:25:50.660505 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User: tempest-TestVolumeBootPattern-1448431353-project Sep 14 01:25:50.660505 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Id: default Sep 14 01:25:50.660505 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Domain-Name: Default Sep 14 01:25:50.660505 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Id: b1494511685b47519f4aa0674009fbfc Sep 14 01:25:50.660505 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: X-User-Name: tempest-TestVolumeBootPattern-1448431353-project Sep 14 01:25:50.660505 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: method: > Sep 14 01:25:50.660505 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: exception: Instance b27979fc-e36a-4644-9d51-55c6c105c7a9 could not be found. Sep 14 01:25:50.660505 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: action_args: {'id': 'b27979fc-e36a-4644-9d51-55c6c105c7a9'} Sep 14 01:25:50.661612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: {{(pid=120620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 01:25:50.661612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:25:50.661612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 01:25:50.661612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 01:25:50.661612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 01:25:50.661612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 01:25:50.661612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 01:25:50.661612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 01:25:50.661612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 01:25:50.661612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 01:25:50.661612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27979fc-e36a-4644-9d51-55c6c105c7a9 could not be found. Sep 14 01:25:50.661612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:25:50.661612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:25:50.661612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:25:50.661612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:25:50.661612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:25:50.661612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:25:50.661612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 01:25:50.661612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 01:25:50.661612 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 01:25:50.663333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 01:25:50.663333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 01:25:50.663333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 01:25:50.663333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 01:25:50.663333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 01:25:50.663333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 01:25:50.663333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 01:25:50.663333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27979fc-e36a-4644-9d51-55c6c105c7a9 could not be found. Sep 14 01:25:50.663333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:25:50.663333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 01:25:50.663333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:25:50.663333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 01:25:50.663333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 01:25:50.663333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 01:25:50.663333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 01:25:50.663333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 01:25:50.663333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27979fc-e36a-4644-9d51-55c6c105c7a9 could not be found. Sep 14 01:25:50.663333 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: ERROR nova.api.openstack.wsgi Sep 14 01:25:50.664992 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: DEBUG nova.api.openstack.wsgi [None req-6d7824b2-36c4-4ea4-b106-0aa2d2825145 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Returning 404 to user: Instance b27979fc-e36a-4644-9d51-55c6c105c7a9 could not be found. {{(pid=120620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 01:25:50.664992 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: INFO nova.api.openstack.requestlog [None req-6d7824b2-36c4-4ea4-b106-0aa2d2825145 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9" status: 404 len: 111 microversion: 2.1 time: 0.030040 Sep 14 01:25:50.664992 dv-cinder-857528-1-iscsi devstack@n-api.service[120620]: [pid: 120620|app: 0|req: 637/1260] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 01:25:50 2022] GET /compute/v2.1/servers/b27979fc-e36a-4644-9d51-55c6c105c7a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 01:25:51.954215 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: DEBUG nova.api.openstack.wsgi [None req-6a2f373c-9943-496b-98e5-8426792beb21 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] Calling method '.version_select at 0x7f5043e20430>' {{(pid=120621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 01:25:51.958851 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6a2f373c-9943-496b-98e5-8426792beb21 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [341024d5-aa0d-41f9-926a-3a74fd93c5f2] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 01:25:52.967163 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO oslo.messaging._drivers.impl_rabbit [None req-6a2f373c-9943-496b-98e5-8426792beb21 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] [341024d5-aa0d-41f9-926a-3a74fd93c5f2] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 43838. Sep 14 01:25:52.986658 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: INFO nova.api.openstack.requestlog [None req-6a2f373c-9943-496b-98e5-8426792beb21 tempest-TestVolumeBootPattern-1448431353 tempest-TestVolumeBootPattern-1448431353-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-787735033" status: 202 len: 0 microversion: 2.1 time: 1.036273 Sep 14 01:25:52.987225 dv-cinder-857528-1-iscsi devstack@n-api.service[120621]: [pid: 120621|app: 0|req: 624/1261] 10.222.0.42 () {58 vars in 1260 bytes} [Wed Sep 14 01:25:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-787735033 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)